-- Logs begin at Sat 2022-09-17 20:25:12 UTC, end at Sat 2022-09-17 21:27:54 UTC. -- Sep 17 20:55:45.703655 dv-cinder-826510-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 17 20:55:45.711406 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 17 20:55:45 2022] *** Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: nodename: dv-cinder-826510-9-iscsi Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: machine: x86_64 Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: clock source: unix Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: pcre jit disabled Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: detected number of CPU cores: 4 Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: current working directory: / Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: detected binary path: /usr/bin/uwsgi-core Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: your processes number limit is 47680 Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: your memory page size is 4096 bytes Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: detected max file descriptor number: 2048 Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: lock engine: pthread robust mutexes Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: thunder lock: enabled Sep 17 20:55:45.714918 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 17 20:55:45.716003 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 17 20:55:45.753355 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: Python main interpreter initialized at 0x562343e5c9c0 Sep 17 20:55:45.753355 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: python threads support enabled Sep 17 20:55:45.753355 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: your server socket listen backlog is limited to 100 connections Sep 17 20:55:45.753355 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: your mercy for graceful operations on workers is 90 seconds Sep 17 20:55:45.753693 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: mapped 403077 bytes (393 KB) for 2 cores Sep 17 20:55:45.753774 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: *** Operational MODE: preforking *** Sep 17 20:55:45.754003 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: *** uWSGI is running in multiple interpreter mode *** Sep 17 20:55:45.754003 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: spawned uWSGI master process (pid: 105599) Sep 17 20:55:45.754190 dv-cinder-826510-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 17 20:55:45.754877 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: spawned uWSGI worker 1 (pid: 105600, cores: 1) Sep 17 20:55:45.755057 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: spawned uWSGI worker 2 (pid: 105601, cores: 1) Sep 17 20:55:45.755207 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 17 20:55:46.415987 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 17 20:55:46.442762 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 17 20:55:47.505263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:55:47.505263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: from cryptography.utils import int_from_bytes Sep 17 20:55:47.505915 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:55:47.505915 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: from cryptography.utils import int_from_bytes Sep 17 20:55:47.505915 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:55:47.505915 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: from cryptography.utils import int_from_bytes Sep 17 20:55:47.506452 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:55:47.506452 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: from cryptography.utils import int_from_bytes Sep 17 20:55:49.971778 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 20:55:49.972516 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 20:55:49.972516 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 20:55:49.972924 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 20:55:49.973276 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 20:55:49.973492 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 20:55:49.973854 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.973945 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 20:55:49.974030 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.974270 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 20:55:49.974359 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.974582 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.974683 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 20:55:49.974878 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 20:55:49.974973 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.975210 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.975307 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.975527 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.975625 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.975842 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.975930 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.976169 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.976269 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.976427 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.976514 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.976765 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.976882 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.977087 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826510-9-iscsi {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.977185 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.977407 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.977493 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.977712 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.977810 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.978013 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.978099 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.978327 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.978435 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.978627 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.978720 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826510-9-iscsi {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.979501 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.979617 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.979809 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.980156 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.980308 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.980485 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.980764 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.980895 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.981076 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.981199 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.981387 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.981511 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.981721 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.981842 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.982033 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.982256 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.982362 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.982575 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.982660 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.982889 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.983021 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.983239 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.983365 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.983550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.983670 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.983853 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.983969 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826510-9-iscsi {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.984154 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.984275 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.984515 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.984629 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.984829 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.984948 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.985138 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.985251 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.985433 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.985539 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.985817 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.985923 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826510-9-iscsi {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.986136 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.986257 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.986458 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.986572 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.986753 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.986858 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.987070 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.987185 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.987387 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.987495 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.987704 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.987817 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.988023 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.988148 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.988362 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.988484 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.988626 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.988746 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.988968 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.989061 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.989266 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.989367 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.989576 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.989675 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.989882 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.990063 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.990143 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.990217 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.990427 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.990537 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.990746 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.990845 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.991064 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.991156 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.991383 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.991490 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.991632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.991728 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.991882 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.991974 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.992221 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.992318 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.992515 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.992609 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.992850 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.992943 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.993159 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.993251 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.993436 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.993514 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.993691 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.993795 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.994034 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.994137 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.994372 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.994505 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.994717 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.994884 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.995011 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.995244 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.995386 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.995618 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.995755 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.995909 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.996040 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.996178 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.996302 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.996615 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.996900 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.996900 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.997348 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.997348 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.997781 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.998006 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.998248 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.998478 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.998730 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.998967 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.999198 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.999347 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.999584 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:49.999818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.000042 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.000194 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.000334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.000473 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.000718 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.000867 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.001028 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.001169 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.001308 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.001459 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.001609 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.001756 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.001894 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.002044 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.002184 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.002424 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.002577 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.002724 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.002863 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.003023 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.003171 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.003321 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.003521 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.003662 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.003800 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.003938 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.004085 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.004235 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.004375 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.004512 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.004650 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.004812 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.004963 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.005115 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.005255 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.005403 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.005542 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.005690 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.005848 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.005988 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.006133 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.006279 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.006418 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.006556 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.006703 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.006852 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.007002 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.007142 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.007289 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.007429 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.007576 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.007714 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.007860 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.008006 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.008144 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.008289 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.008438 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.008577 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.008804 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.008959 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.009099 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.009250 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.009399 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.009539 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.009677 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.009814 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.009814 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.010156 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.010382 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.010618 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.010870 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.011021 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.011160 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.011308 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.011459 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.011614 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.011755 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.011894 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.012033 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.012171 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.012319 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.012548 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.012713 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.012888 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.013033 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.013179 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.013332 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.013524 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.013677 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.013818 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.013957 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.014110 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.014251 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.014389 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.014527 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.014672 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.014822 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.014971 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.015110 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.015256 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.015395 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.015533 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.015671 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.015824 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.015963 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.016109 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.016254 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.016393 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.016531 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.016726 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.016884 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.017031 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.017170 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.017308 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.017455 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.017601 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.017741 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.017880 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.018026 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.018165 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.018312 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.018461 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.018606 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.018744 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.018890 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.019030 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.019177 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.019325 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.019464 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.019601 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.019738 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.019886 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.020026 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.020164 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:55:50.020312 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.020451 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.020597 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.020780 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.020923 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.021070 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.021217 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.021355 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.021499 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.021648 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.021788 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.021788 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.022071 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.022211 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.022356 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.022503 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.022743 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.022894 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.023036 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.023197 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.023422 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.023616 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.023768 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.023908 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.024047 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.024199 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.024339 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.024491 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.024644 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.024822 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.024973 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.025113 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.025261 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.025400 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.025539 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.026181 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.026401 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.026636 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.026840 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.026983 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.027131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.027272 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.027421 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.027561 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.027714 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.027856 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.027995 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.028134 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.028281 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.028423 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.028575 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.028751 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.028907 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.029055 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.029196 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.029344 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.029491 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.029638 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.029786 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.029925 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.030063 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.030219 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.030367 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.030524 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.030664 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.030802 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.030949 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.031097 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.031236 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.031382 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.031522 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.031668 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.031806 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.031961 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.032100 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.032239 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.032387 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.032534 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.032800 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.032973 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.033114 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.033261 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.033408 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.033555 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.033744 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.033897 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.034045 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.034194 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.034334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.034485 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.034634 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.034782 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.034922 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.035059 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.035198 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.035344 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.035496 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.035642 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.035790 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.035930 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.036069 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.036207 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.036371 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.036512 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.036651 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.036817 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.036957 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.037108 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.037247 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.037386 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.037525 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.037664 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.037803 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.037950 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.038089 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.038238 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.038377 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.038516 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.038516 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.038797 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.038953 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.039191 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.039423 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.039653 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.039881 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.040133 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.040385 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.040655 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.040951 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.041194 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.042116 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.042362 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.042613 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.042875 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.043223 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.043462 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.043709 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.044021 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.044218 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.044372 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.044525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.044666 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.044877 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.045020 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.045161 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.045300 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.045300 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.045580 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.045731 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.045870 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.046009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.046147 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.046298 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.046462 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.046603 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.046749 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.046888 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.047026 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.047164 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.047312 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.047452 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.047590 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.047728 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.047866 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.048004 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.048160 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.048302 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.048441 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.048585 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.048748 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.048748 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.049038 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.049185 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.049325 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.049465 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.050823 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.050988 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.051130 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.051282 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.051421 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.051562 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.051701 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.051849 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.052005 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.052151 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.052306 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.052453 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.052599 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.052855 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.053006 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.053172 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.053406 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.053558 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.053704 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.053906 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.054059 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.054204 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.054357 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.054503 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.054659 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.054805 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.054805 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.055102 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.055248 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.055406 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.055560 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.055707 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.055860 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.056006 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.056151 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.056295 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.056453 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.056599 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.056783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.056963 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.057205 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.057484 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.057654 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.057803 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.057961 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.057961 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.058246 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.058402 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.058549 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.058701 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.058893 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.059038 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.059183 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.059343 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.059502 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.059648 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.059792 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.059945 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.060091 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.060091 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.060376 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.060522 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.060666 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.060850 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.061007 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.061007 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.061295 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.061455 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.061600 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.061752 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.061904 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.062066 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.062221 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.062367 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.062512 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.062666 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.062820 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.062967 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.063112 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.063258 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.063441 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.063664 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.063829 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.064030 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.064180 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.064325 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.064470 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.064622 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.064843 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.064992 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.065137 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.065281 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.065434 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.065590 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.065745 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.065899 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.066057 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.066204 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.066357 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.066511 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.066657 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.066801 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.066946 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.067098 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.067244 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.067399 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.067564 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.067718 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.067871 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.068017 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.068162 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.068321 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.068475 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.068631 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.068806 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.068963 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.069108 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.069267 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.069423 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.069577 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.069723 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.069867 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.070012 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.070166 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.070313 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.070457 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.070610 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.070755 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.070909 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.071055 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.071208 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.071365 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.071522 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.071668 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.071820 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.072002 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.072158 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.072303 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.072468 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.072756 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.073046 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.073212 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.073360 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.073516 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.073705 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.073929 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.074134 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.074285 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.074431 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.074578 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.074730 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.074886 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.075033 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.075178 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.075323 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.075476 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.075624 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.075799 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.075947 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.076092 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.076237 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.076389 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.076535 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.076973 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.077128 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.077273 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.077418 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.077562 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.077708 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.077865 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.078029 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.078175 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.078320 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.078320 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.078320 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.078791 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.078953 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.079100 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.079252 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.079405 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.079561 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.079708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.079865 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.080046 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.080195 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.080339 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.080504 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.080658 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.080845 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.080990 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.081135 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.081291 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.081447 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.081593 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.081738 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.081902 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.082047 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.082266 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.082423 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.082578 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.082724 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.082876 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.083031 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.083186 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.083333 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.083333 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.083609 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.083763 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.083942 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.084209 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.084363 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.084542 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.084728 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.084882 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.085036 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.085201 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.085360 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.085514 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.085660 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.085805 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.085960 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.086107 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.086261 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.086408 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.086552 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.086711 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.086857 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.086857 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.087147 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.087294 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.087439 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.087592 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.087737 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.087901 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.088055 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.088866 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.089121 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.089371 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.089556 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.089705 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.089861 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.090007 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.090152 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.090298 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.090443 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.090596 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.090764 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.090911 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.091057 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.091202 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.091361 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.091520 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.091675 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.091822 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.091967 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.092112 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.092257 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.092404 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.092558 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.092739 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.092891 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.093037 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.093182 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.093340 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.093498 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.093644 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.093790 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.093935 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.094080 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.094354 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.094517 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.094675 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.094823 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.094979 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.095127 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.095281 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.095428 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.095574 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.095719 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.095864 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.096009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.096164 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.096311 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.096457 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.096612 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.096819 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.096984 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.097131 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.097288 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.097435 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.097589 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.097735 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.097735 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.098033 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.098131 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.098215 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.098295 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.098371 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.098468 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.098555 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.098640 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.098718 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.098793 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.098869 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.098958 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.099043 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.099122 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.099199 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.099275 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.099364 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.099442 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.099518 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.099594 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.099670 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.099755 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.099841 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.099919 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.100003 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.100080 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.100156 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.100249 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.100339 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.100417 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.100493 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.100568 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.100643 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.100753 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.100847 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.100926 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101018 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101094 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101174 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101259 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101337 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101412 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101494 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101572 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101648 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101733 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101811 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101887 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.101969 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.102046 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.102123 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.102210 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.102295 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.102379 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.102463 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.102540 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.102616 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.102771 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.102860 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.102945 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103098 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103182 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103259 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103336 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103411 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103493 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103571 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103654 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103732 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103832 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103898 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.103970 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.104052 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.104140 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.104219 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.104299 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.104364 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.104364 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.104478 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.104556 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.104630 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.104723 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.104855 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.105027 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.105216 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.105372 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.105523 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.105671 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.105827 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.105977 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.106133 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.106279 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.106445 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.106591 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.106746 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.106901 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.107059 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.107206 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.107352 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.107497 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.107642 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.107786 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.107941 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.108088 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.108233 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.108388 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.108534 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.108727 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.108893 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.109047 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.109195 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.109347 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.109492 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.109647 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.109793 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.109938 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.110090 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.110238 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.110394 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.110552 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.110698 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.110843 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.110988 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.111134 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.111280 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.111438 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.111584 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.111741 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.111887 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.112033 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.112190 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.112356 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.112511 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.112657 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.112827 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.112973 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.113134 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.113281 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.113435 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.113581 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.113726 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.113871 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.114024 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.114170 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.114327 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.114473 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.114618 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.114878 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.115044 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.115192 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.115337 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.115484 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.115629 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.115781 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.115937 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.116084 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.116244 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.116390 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.116536 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.116734 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.116889 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.117034 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.117179 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.117324 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.117468 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.117626 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.117773 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.117925 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.118071 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.118234 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.118389 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.118553 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.118706 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.118860 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.119013 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.119159 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.119303 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.119981 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.120205 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.120436 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.120705 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.120885 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.121057 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.121213 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.121359 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.121519 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.121666 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.121821 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.121978 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.122125 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.122271 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.122416 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.122560 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.122713 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.122885 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.123045 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.123191 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.123336 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.123481 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.123626 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.123781 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.123930 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.124075 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.124220 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.124365 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.124520 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.124666 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.124963 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.125117 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.125264 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.125409 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.125577 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.125725 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.125870 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.126015 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.126161 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.126305 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.126459 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.126605 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.126758 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.126916 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.127063 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.127227 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.127387 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.127534 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.127685 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.127685 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.127969 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.127969 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.128265 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.128265 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.128548 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.128740 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.128903 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.128903 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.129200 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.129354 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.129500 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.129644 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.129789 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.130009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.130167 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.130313 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.130458 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.130602 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.130758 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.130913 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.131058 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.131204 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.131349 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.131502 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.131661 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.131828 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.131984 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.131984 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.132280 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.132427 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.132580 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.132759 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.132922 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.133069 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.133215 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.133361 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.133508 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.133666 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.133821 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.133968 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.134114 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.134259 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.134405 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.134550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.134715 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.134715 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.135177 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.135177 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.135642 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.135642 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.136028 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.136028 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.136872 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.137020 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.137020 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.137331 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.137501 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.137649 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.137795 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.137948 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.138103 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.138260 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.138419 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.138568 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.138715 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.138860 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.139015 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.139172 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.139318 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.139474 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.139621 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.139767 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.139923 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.140070 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.140215 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.140360 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.140505 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.140505 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.140898 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.141049 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.141203 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.141350 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.141514 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.141662 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.141817 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.141971 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.142119 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.142264 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.142409 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.142555 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.142710 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.142857 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.143002 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.143155 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.143301 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.143464 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.143624 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.143785 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.143932 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.144086 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.144234 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.144390 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.144536 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.144706 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.144860 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.145005 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.145269 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.145446 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.145602 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.145749 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.145905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.146060 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.146208 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.146367 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.146514 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.146660 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.146806 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.146960 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.147121 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.147287 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.147445 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.147592 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.147738 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.147883 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.148044 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.148200 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.148348 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.148494 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.148640 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.148839 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.148999 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.149147 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.149300 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.149457 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.149603 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.149749 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.149903 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.150075 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.150226 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.150371 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.150517 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.150730 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.150988 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.151240 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.151438 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.151600 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.151747 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.151908 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.151908 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.152190 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.152336 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.152482 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.152627 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.152807 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.152907 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.152993 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.153075 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.153156 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.153236 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.153326 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.153408 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.153496 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.153576 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.153654 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.153745 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.153834 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.153914 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.153992 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.154070 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.154147 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.154238 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.154319 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.154523 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.154621 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.154834 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.154922 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.155142 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.155241 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.155454 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.155571 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.155766 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.155930 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.156089 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.156236 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.156395 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.156541 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.156753 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.156922 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.157070 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.157216 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.157374 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.157522 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.157668 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.157828 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.157976 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.158130 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.158288 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.158435 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.158582 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.158747 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.158932 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.159090 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.159245 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.159401 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.159549 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.159705 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.159865 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.160012 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.160158 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.160314 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.160471 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.160619 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.160808 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.160956 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.161102 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.161256 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.161417 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.161564 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.161710 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.161856 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.162106 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.162269 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.162431 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.162580 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.162760 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.162910 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.163066 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.163221 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.163381 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.163537 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.163693 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.163840 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.163993 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.164160 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.164307 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.164470 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.164711 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.164869 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.165016 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.165180 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.165443 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.165598 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.165598 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.165888 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.166044 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.166191 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.166452 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.166715 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.166923 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.167074 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.167231 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.167379 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.167525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.167679 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.167829 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.168007 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.168209 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.168360 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.168517 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.168664 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.168844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.169070 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.169220 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.169367 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.169521 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.169667 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.169821 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.169978 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.170126 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.170285 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.170443 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.170590 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.170745 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.170900 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.171048 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.171195 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.171340 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.171485 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.171640 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.171787 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.171787 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.172110 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.172110 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.172403 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.172563 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.172751 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.172919 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.173076 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.173223 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.173379 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.173533 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.173680 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.173826 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.173971 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.174117 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.174284 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.174431 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.174577 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.174730 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.174730 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.175025 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.175025 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.175326 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.175590 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.175738 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.175884 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.176031 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.176205 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.176354 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.176499 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.176646 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.176816 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.176975 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.177123 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.177270 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.177415 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.177560 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.177705 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.177860 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.178007 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.178166 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.178314 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.178459 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.178604 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.178765 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.178915 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.179061 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.179206 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.179353 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.179499 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.179653 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.179800 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.179945 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.180148 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.180299 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.180299 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.180589 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.180777 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.180926 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.181072 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.181216 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.181379 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.181528 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.181673 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.181818 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.182511 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.182751 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.183006 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.183261 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.183426 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.183576 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.183723 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.183870 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.184036 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.184186 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.184332 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.184487 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.184694 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.184875 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.185032 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.185180 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.185326 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.185593 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.185749 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.185905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.186053 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.186200 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.186353 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.186499 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.186652 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.186814 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.186972 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.187118 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.187264 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.187417 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.187564 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.187723 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.187871 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.188017 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.188170 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.188317 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.188471 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.188617 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.188799 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.188960 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.189106 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.189251 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.189417 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.189564 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.189709 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.189857 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.190003 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.190156 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.190156 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.190446 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.190601 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.190747 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.190903 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.191049 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.191204 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.191352 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.191505 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.191652 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.191797 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.191957 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.192112 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.192266 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.192421 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.192567 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.192775 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.192945 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.193094 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.193239 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.193385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.193530 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.193676 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.193831 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.193978 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.194132 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.194286 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.194432 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.194577 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.194741 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.194741 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.195043 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.195190 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.195336 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.195490 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.195744 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.195896 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.195896 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.196174 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.196319 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.196474 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.196632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.196808 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.196967 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.197114 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.197261 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.197417 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.198134 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.198382 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.198634 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.198850 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.199079 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.199230 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.199397 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.199558 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.199558 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.199837 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.199994 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.200142 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.200289 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.200442 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.200590 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.200779 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.200943 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.201092 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.201245 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.201394 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.201552 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.201944 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.202112 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.202267 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.202414 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.202561 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.202706 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.202706 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.202994 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.203140 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.203295 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.203443 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.203610 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.203766 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.203913 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.204059 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.204205 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.204351 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.204506 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.204653 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.204829 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.204977 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.205122 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.205267 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.205435 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.205584 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.205840 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.206001 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.206148 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.206295 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.206450 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.206606 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.206755 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.206901 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.207047 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.207193 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.207365 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.207513 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.207659 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.207806 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.207952 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.207952 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.208240 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.208393 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.208546 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.208742 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.208896 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.209055 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.209211 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.209379 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.209526 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.209673 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.209819 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.209981 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.209981 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.210277 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.210425 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.210571 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.210727 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.210883 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.211031 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.211177 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.211332 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.211479 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.211638 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.211793 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.211941 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.212087 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.212233 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.212379 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.212533 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.212703 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.212857 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.213004 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.213190 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.213396 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.213645 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.213893 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.214086 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.214235 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.214389 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.214547 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.214695 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.214849 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.214996 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.215143 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.215289 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.215461 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.215617 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.215877 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.216040 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.216189 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.216334 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.216491 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.216639 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.216840 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.216987 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.217134 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.217297 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.217445 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.217603 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.217757 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.217905 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.218057 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.218214 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.218361 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.218506 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.218661 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.218809 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.218956 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.219115 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.219271 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.219438 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.219585 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.219739 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.219887 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.220042 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.220189 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.220344 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.220500 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.220646 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.220833 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.220981 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.221136 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.221283 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.221448 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.221596 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.221750 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.221941 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.222096 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.222244 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.222391 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.222537 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.222693 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.222840 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.222986 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.223132 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.223278 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.223435 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.223590 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.223737 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.223883 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.224029 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.224173 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.224329 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.224477 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.224622 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.224811 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.224960 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.225116 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.225292 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.225292 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.225583 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.225741 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.226003 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.226158 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.226314 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.226462 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.226609 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.226754 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.226907 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.227062 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.227234 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.227383 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.227529 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.227675 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.227828 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.228053 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.228203 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.228203 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.228498 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.228498 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.229337 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.229337 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.229821 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.230061 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.230213 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.230369 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.230528 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.230676 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.230824 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.230970 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.231116 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.231116 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 20:55:50.231404 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.231404 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.231404 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.231404 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.231404 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.231404 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.232235 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.232235 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.232513 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.232658 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.232944 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.233278 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.233630 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.233950 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.234300 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.234633 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.234953 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.235268 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.235578 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:55:50.235823 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 20:55:50.383346 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO dbcounter [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Registered counter for database nova_api Sep 17 20:55:50.389439 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO dbcounter [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Registered counter for database nova_api Sep 17 20:55:50.403677 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG oslo_db.sqlalchemy.engines [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:55:50.409180 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_db.sqlalchemy.engines [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:55:50.410321 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG dbcounter [-] [105601] Writer thread running {{(pid=105601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:55:50.415534 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writer thread running {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:55:50.466971 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.context [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e02f9b70-dae4-46dc-9136-6abdbb093c64(cell1) {{(pid=105601) load_cells /opt/stack/nova/nova/context.py:464}} Sep 17 20:55:50.470815 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG oslo_concurrency.lockutils [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:50.471288 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG oslo_concurrency.lockutils [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:50.472484 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.context [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e02f9b70-dae4-46dc-9136-6abdbb093c64(cell1) {{(pid=105600) load_cells /opt/stack/nova/nova/context.py:464}} Sep 17 20:55:50.472874 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG oslo_concurrency.lockutils [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:50.473598 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG oslo_concurrency.lockutils [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:50.474056 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG oslo_concurrency.lockutils [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:50.476008 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG oslo_concurrency.lockutils [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:50.476266 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:50.476767 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:50.478114 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO dbcounter [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Registered counter for database nova_cell0 Sep 17 20:55:50.478338 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:50.479606 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:50.480057 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:50.482171 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:50.482942 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO dbcounter [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Registered counter for database nova_cell1 Sep 17 20:55:50.484168 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO dbcounter [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Registered counter for database nova_cell0 Sep 17 20:55:50.488141 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO dbcounter [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Registered counter for database nova_cell1 Sep 17 20:55:50.490770 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG oslo_db.sqlalchemy.engines [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:55:50.492189 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG oslo_db.sqlalchemy.engines [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:55:50.495735 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_db.sqlalchemy.engines [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:55:50.499190 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_db.sqlalchemy.engines [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:55:50.499571 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG dbcounter [-] [105601] Writer thread running {{(pid=105601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:55:50.502411 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG dbcounter [-] [105601] Writer thread running {{(pid=105601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:55:50.502538 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writer thread running {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:55:50.639357 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writer thread running {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:55:50.645792 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO dbcounter [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Registered counter for database nova_cell0 Sep 17 20:55:50.649282 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO dbcounter [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Registered counter for database nova_cell0 Sep 17 20:55:50.655348 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG oslo_db.sqlalchemy.engines [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:55:50.658717 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_db.sqlalchemy.engines [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:55:50.660212 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG dbcounter [-] [105601] Writer thread running {{(pid=105601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:55:50.663397 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writer thread running {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:55:51.003642 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: WARNING keystonemiddleware.auth_token [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 20:55:51.007727 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: WARNING keystonemiddleware.auth_token [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 20:55:51.011758 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: WARNING keystonemiddleware.auth_token [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 20:55:51.015887 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: WARNING keystonemiddleware.auth_token [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 20:55:51.356543 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: WARNING keystonemiddleware.auth_token [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 20:55:51.362504 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: WARNING keystonemiddleware.auth_token [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 20:55:51.367771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562343e5c9c0 pid: 105600 (default app) Sep 17 20:55:51.370462 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:51.371675 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002352 Sep 17 20:55:51.372365 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Sat Sep 17 20:55:51 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:51.373152 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: WARNING keystonemiddleware.auth_token [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 20:55:51.379100 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: WARNING keystonemiddleware.auth_token [None req-4ecf9dc2-6124-457e-b6a3-322289d8245d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 20:55:51.384384 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562343e5c9c0 pid: 105601 (default app) Sep 17 20:57:13.056342 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:13.057395 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 17 20:57:13.057789 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:13.069617 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG dbcounter [-] [105601] Writing DB stats nova_api:SELECT=3 {{(pid=105601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:13.070798 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG dbcounter [-] [105601] Writing DB stats nova_cell0:SELECT=3 {{(pid=105601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:13.071648 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG dbcounter [-] [105601] Writing DB stats nova_cell1:SELECT=3 {{(pid=105601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:13.072637 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG dbcounter [-] [105601] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:13.942955 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-f4f6bed9-da9c-4969-9485-f75131ff9430 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:13.975982 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-f4f6bed9-da9c-4969-9485-f75131ff9430 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.911387 Sep 17 20:57:13.976734 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 17 20:57:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:16.651923 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:16.652973 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-4147c475-2447-49ec-81dc-a824bb6062c4 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Sep 17 20:57:16.653375 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:57:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:17.111185 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-d5668d8d-bdb5-4433-b01e-2b4825f7b939 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:17.160422 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-d5668d8d-bdb5-4433-b01e-2b4825f7b939 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.500711 Sep 17 20:57:17.161006 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 17 20:57:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:57:17.175533 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writing DB stats nova_api:SELECT=3 {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:17.177626 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writing DB stats nova_cell0:SELECT=3 {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:17.178446 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writing DB stats nova_cell1:SELECT=3 {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:17.179234 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:17.389938 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-1cafef01-cd8e-40b0-bb29-22cfa518ca6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:17.458826 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-1cafef01-cd8e-40b0-bb29-22cfa518ca6e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288604 Sep 17 20:57:17.459963 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Sep 17 20:57:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:20.069714 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-d5668d8d-bdb5-4433-b01e-2b4825f7b939 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:20.071461 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-d5668d8d-bdb5-4433-b01e-2b4825f7b939 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Sep 17 20:57:20.072304 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:57:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:20.728021 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-bc6fc4ab-07eb-43d6-b6f4-50213b66e7ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:20.769758 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-bc6fc4ab-07eb-43d6-b6f4-50213b66e7ec admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.689914 Sep 17 20:57:20.776772 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 17 20:57:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:57:20.782804 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-47daf2b9-1a22-4486-a907-7651189c8cef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:20.826977 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-47daf2b9-1a22-4486-a907-7651189c8cef admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048515 Sep 17 20:57:20.827879 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Sep 17 20:57:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:23.430567 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-bc6fc4ab-07eb-43d6-b6f4-50213b66e7ec admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:23.431577 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-bc6fc4ab-07eb-43d6-b6f4-50213b66e7ec admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 17 20:57:23.431984 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:57:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:23.850220 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-cf731f1d-6151-4200-a81d-a6054a23e71f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:23.869980 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-cf731f1d-6151-4200-a81d-a6054a23e71f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431750 Sep 17 20:57:23.870692 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 17 20:57:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:57:23.882846 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-36214caa-09da-4ee6-836d-ed99fc591ad3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:23.910389 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-36214caa-09da-4ee6-836d-ed99fc591ad3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031508 Sep 17 20:57:23.910962 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Sep 17 20:57:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:26.567719 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-cf731f1d-6151-4200-a81d-a6054a23e71f admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:26.569376 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-cf731f1d-6151-4200-a81d-a6054a23e71f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002091 Sep 17 20:57:26.569778 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:57:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:26.982853 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-10a9193d-2738-403c-a43b-41f84b474031 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:27.003408 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-10a9193d-2738-403c-a43b-41f84b474031 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427625 Sep 17 20:57:27.004710 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 17 20:57:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 17 20:57:27.016512 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-45c2395f-c9af-4372-818a-a6ed97304e1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:27.046071 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-45c2395f-c9af-4372-818a-a6ed97304e1a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033440 Sep 17 20:57:27.051399 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Sep 17 20:57:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:29.653598 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-10a9193d-2738-403c-a43b-41f84b474031 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:29.654764 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-10a9193d-2738-403c-a43b-41f84b474031 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Sep 17 20:57:29.655174 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:57:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:30.087156 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-e9a593e3-e36a-4799-b6c7-537a8adff675 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20}} {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:30.110550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-e9a593e3-e36a-4799-b6c7-537a8adff675 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449031 Sep 17 20:57:30.111263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 17 20:57:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:57:30.123381 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-06a0bfc6-35bb-4e8b-8cb8-c05e78142d7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:30.150734 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-06a0bfc6-35bb-4e8b-8cb8-c05e78142d7b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030986 Sep 17 20:57:30.151326 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Sep 17 20:57:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:33.193709 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-e9a593e3-e36a-4799-b6c7-537a8adff675 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:33.194800 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-e9a593e3-e36a-4799-b6c7-537a8adff675 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002282 Sep 17 20:57:33.195224 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:57:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:33.627853 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-bdcbf54e-6b32-4dda-8a6e-84a18b4baa68 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:33.654824 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-bdcbf54e-6b32-4dda-8a6e-84a18b4baa68 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.452843 Sep 17 20:57:33.655371 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 17 20:57:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:36.555720 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-e9a593e3-e36a-4799-b6c7-537a8adff675 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:36.556809 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-e9a593e3-e36a-4799-b6c7-537a8adff675 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 17 20:57:36.557266 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:36.971662 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-f2d0617a-1e50-45ae-9ebc-38000d6e2730 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:36.993893 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-f2d0617a-1e50-45ae-9ebc-38000d6e2730 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.430444 Sep 17 20:57:36.994632 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 17 20:57:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 17 20:57:37.006762 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-3645e510-799f-4d00-b746-c53d969173f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:37.034493 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-3645e510-799f-4d00-b746-c53d969173f6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031361 Sep 17 20:57:37.045038 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Sep 17 20:57:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:39.796556 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-f2d0617a-1e50-45ae-9ebc-38000d6e2730 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:39.797599 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-f2d0617a-1e50-45ae-9ebc-38000d6e2730 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 17 20:57:39.797998 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:40.211484 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-3d0ef53b-c191-43dc-81d7-53610a01de59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2"}} {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:40.231532 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-3d0ef53b-c191-43dc-81d7-53610a01de59 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.427437 Sep 17 20:57:40.232769 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 17 20:57:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 17 20:57:40.245087 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-304f930b-cca0-40aa-8ec7-c1ee7fad5b4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:40.272604 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-304f930b-cca0-40aa-8ec7-c1ee7fad5b4c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031190 Sep 17 20:57:40.273553 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Sep 17 20:57:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:42.882118 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-3d0ef53b-c191-43dc-81d7-53610a01de59 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:42.883888 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-3d0ef53b-c191-43dc-81d7-53610a01de59 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002306 Sep 17 20:57:42.884481 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:43.343174 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-5e7a3972-ac12-4646-b905-502527b9172b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium"}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:43.363635 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-5e7a3972-ac12-4646-b905-502527b9172b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.472817 Sep 17 20:57:43.364183 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 17 20:57:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:57:43.376776 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-61f071e3-3942-4caf-ae6e-cb1829112522 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:43.383172 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG dbcounter [-] [105601] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:43.410193 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-61f071e3-3942-4caf-ae6e-cb1829112522 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037167 Sep 17 20:57:43.410776 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Sep 17 20:57:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:46.102181 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-5e7a3972-ac12-4646-b905-502527b9172b admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:46.103103 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-5e7a3972-ac12-4646-b905-502527b9172b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 17 20:57:46.103499 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:57:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:46.552019 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-b5e0fc79-f2fe-4752-95d0-ba0180243574 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "vcpus": 4, "ram": 8192, "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true}} {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:46.575984 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-b5e0fc79-f2fe-4752-95d0-ba0180243574 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466087 Sep 17 20:57:46.584632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 17 20:57:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:57:46.589522 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-391877dc-6940-4a8e-a9fa-ac0850ec9d17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:46.615765 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-391877dc-6940-4a8e-a9fa-ac0850ec9d17 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029915 Sep 17 20:57:46.616489 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Sep 17 20:57:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:49.239675 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-b5e0fc79-f2fe-4752-95d0-ba0180243574 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:49.240621 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-b5e0fc79-f2fe-4752-95d0-ba0180243574 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 17 20:57:49.241251 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:57:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:49.676698 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-4f7da633-f4fa-4ab8-8ab3-c7fbaeff1622 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:49.684380 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:49.700116 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-4f7da633-f4fa-4ab8-8ab3-c7fbaeff1622 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.453053 Sep 17 20:57:49.700960 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 17 20:57:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:57:49.714330 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-f927fc5f-f364-4305-b885-4347ef0d2542 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:49.748363 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-f927fc5f-f364-4305-b885-4347ef0d2542 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038407 Sep 17 20:57:49.749345 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Sep 17 20:57:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:06.258472 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-4f7da633-f4fa-4ab8-8ab3-c7fbaeff1622 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:06.259523 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-4f7da633-f4fa-4ab8-8ab3-c7fbaeff1622 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 17 20:58:06.259926 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:06.271285 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG dbcounter [-] [105601] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:06.646016 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-b76cfb7a-5e94-4b33-9b92-13bc23783895 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:06.663655 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-b76cfb7a-5e94-4b33-9b92-13bc23783895 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397637 Sep 17 20:58:06.664181 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 17 20:58:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:58:07.964978 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-4f7da633-f4fa-4ab8-8ab3-c7fbaeff1622 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:07.965981 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-4f7da633-f4fa-4ab8-8ab3-c7fbaeff1622 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 17 20:58:07.966374 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 17 20:58:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:08.480838 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-9a0f1586-1cc7-47b5-b5a4-06b12410b37c admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:08.486031 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.wsgi [None req-9a0f1586-1cc7-47b5-b5a4-06b12410b37c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-9a0f1586-1cc7-47b5-b5a4-06b12410b37c admin admin] Request method failure captured: Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Accept: application/json Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Accept-Encoding: gzip, deflate Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Connection: keep-alive Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Content-Length: 0 Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Host: 10.222.0.16 Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Openstack-Api-Version: compute 2.92 Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Openstack-System-Scope: None Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: User-Agent: python-novaclient Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Auth-Token: gAAAAABjJjTf4QBPC5ktMHA7Rnljwfs3XROP4oLgNwYBnQiQgRzzDbtEKjXqfFlJz_B1wtMDt2aEfnc5ro7pbNOBjCJDxQYaVoTweUHGT-_kkPapcjkus1ZGsRVpwu0g327HeV0xGurU0I9ZqrW4tOw5T2Z7nkAeLZ8SdJ7YnQOTYQgm3vRe2ec Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Domain-Id: None Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Domain-Name: None Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Identity-Status: Confirmed Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Is-Admin-Project: True Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Openstack-Nova-Api-Version: 2.92 Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Project-Domain-Id: default Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Project-Domain-Name: Default Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Project-Id: 54beae32846044a3b8e04220f82543ad Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Project-Name: admin Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Role: member,reader,admin Sep 17 20:58:08.489323 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Roles: member,reader,admin Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54beae32846044a3b8e04220f82543ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54beae32846044a3b8e04220f82543ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54beae32846044a3b8e04220f82543ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54beae32846044a3b8e04220f82543ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Tenant: admin Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Tenant-Id: 54beae32846044a3b8e04220f82543ad Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Tenant-Name: admin Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User: admin Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User-Domain-Id: default Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User-Domain-Name: Default Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User-Id: 00fcf728ae7844bf9da557cf68143974 Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User-Name: admin Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: method: > Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: exception: Flavor 42 could not be found. Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: action_args: {'id': '42'} Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:08.490783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:08.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:08.493300 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-9a0f1586-1cc7-47b5-b5a4-06b12410b37c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:08.494542 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-9a0f1586-1cc7-47b5-b5a4-06b12410b37c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.388722 Sep 17 20:58:08.494542 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Sep 17 20:58:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:58:08.500698 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-441e49f7-584c-4111-917a-c03495168903 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:08.524921 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-441e49f7-584c-4111-917a-c03495168903 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028013 Sep 17 20:58:08.525470 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Sep 17 20:58:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:58:08.536058 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-5d010454-0441-4c65-be46-b656ea79a5d5 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:08.557950 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-5d010454-0441-4c65-be46-b656ea79a5d5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026438 Sep 17 20:58:08.558483 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Sep 17 20:58:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:58:08.568512 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-8b4411dd-f433-4234-a97f-51d79ed4c5e7 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:08.573981 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.wsgi [None req-8b4411dd-f433-4234-a97f-51d79ed4c5e7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-8b4411dd-f433-4234-a97f-51d79ed4c5e7 admin admin] Request method failure captured: Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Accept: application/json Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Accept-Encoding: gzip, deflate Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Connection: keep-alive Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Content-Length: 0 Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Host: 10.222.0.16 Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Openstack-Api-Version: compute 2.92 Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Openstack-System-Scope: None Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: User-Agent: python-novaclient Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Auth-Token: gAAAAABjJjTf4QBPC5ktMHA7Rnljwfs3XROP4oLgNwYBnQiQgRzzDbtEKjXqfFlJz_B1wtMDt2aEfnc5ro7pbNOBjCJDxQYaVoTweUHGT-_kkPapcjkus1ZGsRVpwu0g327HeV0xGurU0I9ZqrW4tOw5T2Z7nkAeLZ8SdJ7YnQOTYQgm3vRe2ec Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Domain-Id: None Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Domain-Name: None Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Identity-Status: Confirmed Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Is-Admin-Project: True Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Openstack-Nova-Api-Version: 2.92 Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Project-Domain-Id: default Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Project-Domain-Name: Default Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Project-Id: 54beae32846044a3b8e04220f82543ad Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Project-Name: admin Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Role: member,reader,admin Sep 17 20:58:08.577574 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Roles: member,reader,admin Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54beae32846044a3b8e04220f82543ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54beae32846044a3b8e04220f82543ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54beae32846044a3b8e04220f82543ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54beae32846044a3b8e04220f82543ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Tenant: admin Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Tenant-Id: 54beae32846044a3b8e04220f82543ad Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Tenant-Name: admin Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User: admin Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User-Domain-Id: default Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User-Domain-Name: Default Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User-Id: 00fcf728ae7844bf9da557cf68143974 Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User-Name: admin Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: method: > Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: exception: Flavor 42 could not be found. Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: action_args: {'id': '42'} Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:08.578968 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:08.579736 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:08.580771 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-8b4411dd-f433-4234-a97f-51d79ed4c5e7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:08.581730 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-8b4411dd-f433-4234-a97f-51d79ed4c5e7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014860 Sep 17 20:58:08.581730 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Sep 17 20:58:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:58:09.796842 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-5d010454-0441-4c65-be46-b656ea79a5d5 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:09.797869 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-5d010454-0441-4c65-be46-b656ea79a5d5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 17 20:58:09.798275 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 17 20:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:10.316867 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-52592b8b-cf3a-4aef-b0f8-d3c23b0c33be admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:10.321837 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.wsgi [None req-52592b8b-cf3a-4aef-b0f8-d3c23b0c33be admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-52592b8b-cf3a-4aef-b0f8-d3c23b0c33be admin admin] Request method failure captured: Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Accept: application/json Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Accept-Encoding: gzip, deflate Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Connection: keep-alive Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Content-Length: 0 Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Host: 10.222.0.16 Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Openstack-Api-Version: compute 2.92 Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Openstack-System-Scope: None Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: User-Agent: python-novaclient Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Auth-Token: gAAAAABjJjTh5ec_vxHC95hGxJChKpizMMU0mU6Eun_5Ft-Qe8Wq2RtEPoq8-hykOqKtQEqn_aVVpcopWMnfR5AxQjfPc8lXBZVi-XfpZxiI9UYulMmxsVA5OtW_kX3kW11Lc2zsrK1MDgACzXpGbvLMVncpeUqncZCEcTfAbZi8lBGmQ8xANXw Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Domain-Id: None Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Domain-Name: None Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Identity-Status: Confirmed Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Is-Admin-Project: True Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Openstack-Nova-Api-Version: 2.92 Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Project-Domain-Id: default Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Project-Domain-Name: Default Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Project-Id: 54beae32846044a3b8e04220f82543ad Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Project-Name: admin Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Role: member,reader,admin Sep 17 20:58:10.323334 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Roles: member,reader,admin Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54beae32846044a3b8e04220f82543ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54beae32846044a3b8e04220f82543ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54beae32846044a3b8e04220f82543ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54beae32846044a3b8e04220f82543ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Tenant: admin Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Tenant-Id: 54beae32846044a3b8e04220f82543ad Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Tenant-Name: admin Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User: admin Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User-Domain-Id: default Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User-Domain-Name: Default Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User-Id: 00fcf728ae7844bf9da557cf68143974 Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User-Name: admin Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: method: > Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: exception: Flavor 84 could not be found. Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: action_args: {'id': '84'} Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:10.324852 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:10.325905 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.327131 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-52592b8b-cf3a-4aef-b0f8-d3c23b0c33be admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:10.328146 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-52592b8b-cf3a-4aef-b0f8-d3c23b0c33be admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.390824 Sep 17 20:58:10.328146 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Sep 17 20:58:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:58:10.335635 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-9190c650-b647-4ea3-9be9-327888770d64 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:10.351411 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-9190c650-b647-4ea3-9be9-327888770d64 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020321 Sep 17 20:58:10.351960 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Sep 17 20:58:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:58:10.361079 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-44f271a4-c7f1-41b5-9158-4f01b3b99ba4 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:10.376363 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-44f271a4-c7f1-41b5-9158-4f01b3b99ba4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018658 Sep 17 20:58:10.376934 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Sep 17 20:58:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:58:10.386487 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-81897e1d-6c1e-4996-93fe-08d56e056db4 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:10.391639 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.wsgi [None req-81897e1d-6c1e-4996-93fe-08d56e056db4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-81897e1d-6c1e-4996-93fe-08d56e056db4 admin admin] Request method failure captured: Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Accept: application/json Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Accept-Encoding: gzip, deflate Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Connection: keep-alive Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Content-Length: 0 Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Host: 10.222.0.16 Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Openstack-Api-Version: compute 2.92 Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Openstack-System-Scope: None Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: User-Agent: python-novaclient Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Auth-Token: gAAAAABjJjTh5ec_vxHC95hGxJChKpizMMU0mU6Eun_5Ft-Qe8Wq2RtEPoq8-hykOqKtQEqn_aVVpcopWMnfR5AxQjfPc8lXBZVi-XfpZxiI9UYulMmxsVA5OtW_kX3kW11Lc2zsrK1MDgACzXpGbvLMVncpeUqncZCEcTfAbZi8lBGmQ8xANXw Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Domain-Id: None Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Domain-Name: None Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Identity-Status: Confirmed Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Is-Admin-Project: True Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Openstack-Nova-Api-Version: 2.92 Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Project-Domain-Id: default Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Project-Domain-Name: Default Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Project-Id: 54beae32846044a3b8e04220f82543ad Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Project-Name: admin Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Role: member,reader,admin Sep 17 20:58:10.393263 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Roles: member,reader,admin Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54beae32846044a3b8e04220f82543ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54beae32846044a3b8e04220f82543ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54beae32846044a3b8e04220f82543ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54beae32846044a3b8e04220f82543ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Tenant: admin Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Tenant-Id: 54beae32846044a3b8e04220f82543ad Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Tenant-Name: admin Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User: admin Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User-Domain-Id: default Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User-Domain-Name: Default Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User-Id: 00fcf728ae7844bf9da557cf68143974 Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User-Name: admin Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: method: > Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: exception: Flavor 84 could not be found. Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: action_args: {'id': '84'} Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:10.395550 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:10.396525 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.397844 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-81897e1d-6c1e-4996-93fe-08d56e056db4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:10.399063 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-81897e1d-6c1e-4996-93fe-08d56e056db4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011734 Sep 17 20:58:10.399063 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Sep 17 20:58:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:58:11.614597 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-44f271a4-c7f1-41b5-9158-4f01b3b99ba4 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:11.615605 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-44f271a4-c7f1-41b5-9158-4f01b3b99ba4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 17 20:58:11.616004 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 17 20:58:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:12.131230 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-5e2534b7-2880-4062-8d8b-e3b980036e51 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:12.137222 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.wsgi [None req-5e2534b7-2880-4062-8d8b-e3b980036e51 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-5e2534b7-2880-4062-8d8b-e3b980036e51 admin admin] Request method failure captured: Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Accept: application/json Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Accept-Encoding: gzip, deflate Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Connection: keep-alive Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Content-Length: 0 Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Host: 10.222.0.16 Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Openstack-Api-Version: compute 2.92 Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Openstack-System-Scope: None Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: User-Agent: python-novaclient Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Auth-Token: gAAAAABjJjTjhUvvC679eq3eqMgKFQ3fHhlFvHIOKNss-XUcUoNyAltErN8JGIqu9ZZxL-CwFDE3um-BvjOv5tTeIpfrwDTypbOqtpe8SWiMCZWB6yCdAobtZ67LFeNufEULNgDa9hXVSmkEabqQ6E2g_6gmiPBPIXv6KEV3PeTiHDBNgbFbVZs Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Domain-Id: None Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Domain-Name: None Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Identity-Status: Confirmed Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Is-Admin-Project: True Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Openstack-Nova-Api-Version: 2.92 Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Project-Domain-Id: default Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Project-Domain-Name: Default Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Project-Id: 54beae32846044a3b8e04220f82543ad Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Project-Name: admin Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Role: member,reader,admin Sep 17 20:58:12.138708 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Roles: member,reader,admin Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54beae32846044a3b8e04220f82543ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54beae32846044a3b8e04220f82543ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54beae32846044a3b8e04220f82543ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54beae32846044a3b8e04220f82543ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Tenant: admin Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Tenant-Id: 54beae32846044a3b8e04220f82543ad Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-Tenant-Name: admin Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User: admin Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User-Domain-Id: default Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User-Domain-Name: Default Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User-Id: 00fcf728ae7844bf9da557cf68143974 Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: X-User-Name: admin Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: method: > Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: exception: Flavor 451 could not be found. Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: action_args: {'id': '451'} Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:12.140227 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:12.141146 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: ERROR nova.api.openstack.wsgi Sep 17 20:58:12.142632 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-5e2534b7-2880-4062-8d8b-e3b980036e51 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:12.143922 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-5e2534b7-2880-4062-8d8b-e3b980036e51 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388460 Sep 17 20:58:12.143922 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 17 20:58:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:58:12.149896 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-5316b254-85bc-407a-a568-512eef1c17e9 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:12.165036 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-5316b254-85bc-407a-a568-512eef1c17e9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018606 Sep 17 20:58:12.165556 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Sep 17 20:58:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:58:12.174788 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:12.190165 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018911 Sep 17 20:58:12.190690 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Sep 17 20:58:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:58:12.199742 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-d6663c60-f32c-4bb3-9be0-1c6b37dace40 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:12.204904 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.wsgi [None req-d6663c60-f32c-4bb3-9be0-1c6b37dace40 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-d6663c60-f32c-4bb3-9be0-1c6b37dace40 admin admin] Request method failure captured: Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Accept: application/json Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Accept-Encoding: gzip, deflate Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Connection: keep-alive Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Content-Length: 0 Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Host: 10.222.0.16 Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Openstack-Api-Version: compute 2.92 Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Openstack-System-Scope: None Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: User-Agent: python-novaclient Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Auth-Token: gAAAAABjJjTjhUvvC679eq3eqMgKFQ3fHhlFvHIOKNss-XUcUoNyAltErN8JGIqu9ZZxL-CwFDE3um-BvjOv5tTeIpfrwDTypbOqtpe8SWiMCZWB6yCdAobtZ67LFeNufEULNgDa9hXVSmkEabqQ6E2g_6gmiPBPIXv6KEV3PeTiHDBNgbFbVZs Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Domain-Id: None Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Domain-Name: None Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Identity-Status: Confirmed Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Is-Admin-Project: True Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Openstack-Nova-Api-Version: 2.92 Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Project-Domain-Id: default Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Project-Domain-Name: Default Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Project-Id: 54beae32846044a3b8e04220f82543ad Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Project-Name: admin Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Role: member,reader,admin Sep 17 20:58:12.206385 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Roles: member,reader,admin Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54beae32846044a3b8e04220f82543ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54beae32846044a3b8e04220f82543ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54beae32846044a3b8e04220f82543ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54beae32846044a3b8e04220f82543ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Tenant: admin Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Tenant-Id: 54beae32846044a3b8e04220f82543ad Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-Tenant-Name: admin Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User: admin Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User-Domain-Id: default Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User-Domain-Name: Default Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User-Id: 00fcf728ae7844bf9da557cf68143974 Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: X-User-Name: admin Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: method: > Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: exception: Flavor 451 could not be found. Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: action_args: {'id': '451'} Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:12.208022 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:12.209009 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: ERROR nova.api.openstack.wsgi Sep 17 20:58:12.210292 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-d6663c60-f32c-4bb3-9be0-1c6b37dace40 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:12.211512 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-d6663c60-f32c-4bb3-9be0-1c6b37dace40 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011408 Sep 17 20:58:12.211512 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 17 20:58:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:58:13.421813 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:13.422832 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 17 20:58:13.423228 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 17 20:58:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:13.948373 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-8697944d-cd43-48f8-bb30-da04ff62a016 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:13.969298 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-8697944d-cd43-48f8-bb30-da04ff62a016 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.408256 Sep 17 20:58:13.969837 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Sep 17 20:58:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:58:15.191615 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:15.192622 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 17 20:58:15.193051 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 17 20:58:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:15.708797 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-171b31b7-d647-49ec-bc49-bd90c5e189c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:15.726445 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-171b31b7-d647-49ec-bc49-bd90c5e189c8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.396673 Sep 17 20:58:15.726995 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Sep 17 20:58:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:58:16.949347 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:16.950609 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 17 20:58:16.951007 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 17 20:58:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:17.470661 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-43a42885-6792-4f53-9b60-cc82c2bd7136 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:17.491355 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-43a42885-6792-4f53-9b60-cc82c2bd7136 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.403140 Sep 17 20:58:17.491890 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Sep 17 20:58:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:58:18.725417 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:18.726453 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 17 20:58:18.726843 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 17 20:58:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:19.248573 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-40f891ee-6e20-4db9-8fa4-0c3e0ebe4e2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:19.272529 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-40f891ee-6e20-4db9-8fa4-0c3e0ebe4e2b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.409002 Sep 17 20:58:19.273091 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Sep 17 20:58:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:58:20.502070 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:20.503081 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 17 20:58:20.503477 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 17 20:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:21.032797 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-b1492ef3-9aae-4246-a9ca-ce1425a17e6c admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:21.053910 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-b1492ef3-9aae-4246-a9ca-ce1425a17e6c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399548 Sep 17 20:58:21.054447 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Sat Sep 17 20:58:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:17.714787 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:17.715797 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-96d44b2e-1cd2-48d9-9ae3-61a2bd5b5228 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 17 20:59:17.716195 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 17 20:59:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:17.727217 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:18.105405 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-e3ad78b7-7c8a-4de8-b4d5-b58c3f622a1b admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:18.125807 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-e3ad78b7-7c8a-4de8-b4d5-b58c3f622a1b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402992 Sep 17 20:59:18.126358 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 17 20:59:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:59:18.148014 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG dbcounter [-] [105601] Writing DB stats nova_api:SELECT=14 {{(pid=105601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:18.151783 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-2a0ea2c3-a9b0-4c6d-8fbe-5b1d2a4ab57c admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:18.159284 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-2a0ea2c3-a9b0-4c6d-8fbe-5b1d2a4ab57c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012692 Sep 17 20:59:18.159814 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Sat Sep 17 20:59:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:18.171414 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-a183708c-b9fb-4c21-8fd9-e3db7bd6d009 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:18.178702 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-a183708c-b9fb-4c21-8fd9-e3db7bd6d009 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010895 Sep 17 20:59:18.179211 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Sat Sep 17 20:59:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:18.190875 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-09fd4e49-995f-4dd3-b09f-5d2705877b84 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:18.197910 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-09fd4e49-995f-4dd3-b09f-5d2705877b84 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011010 Sep 17 20:59:18.198423 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Sat Sep 17 20:59:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:18.210606 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-d5eec029-ade6-4f50-913d-d0722070d790 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:18.217651 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-d5eec029-ade6-4f50-913d-d0722070d790 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010599 Sep 17 20:59:18.218154 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Sat Sep 17 20:59:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:02:14.704217 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-09fd4e49-995f-4dd3-b09f-5d2705877b84 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:14.705266 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-09fd4e49-995f-4dd3-b09f-5d2705877b84 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 17 21:02:14.705694 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 17 21:02:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:14.845806 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writing DB stats nova_api:SELECT=6 {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:15.007048 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-1bdf13de-e276-4de9-ae1d-e06c1d7027bc admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:15.011873 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-1bdf13de-e276-4de9-ae1d-e06c1d7027bc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:15.012349 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-1bdf13de-e276-4de9-ae1d-e06c1d7027bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:15.012810 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-1bdf13de-e276-4de9-ae1d-e06c1d7027bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:15.013518 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-1bdf13de-e276-4de9-ae1d-e06c1d7027bc admin admin] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:15.014488 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-1bdf13de-e276-4de9-ae1d-e06c1d7027bc admin admin] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:15.015118 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-1bdf13de-e276-4de9-ae1d-e06c1d7027bc admin admin] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:15.046569 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-1bdf13de-e276-4de9-ae1d-e06c1d7027bc admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.201997 Sep 17 21:02:15.047129 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 17 21:02:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:02:16.131988 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-09fd4e49-995f-4dd3-b09f-5d2705877b84 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:16.133070 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-09fd4e49-995f-4dd3-b09f-5d2705877b84 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Sep 17 21:02:16.133420 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 17 21:02:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:16.327250 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-bb5e22b1-774e-49cb-ac49-ea5dc9a6b072 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:16.330841 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-bb5e22b1-774e-49cb-ac49-ea5dc9a6b072 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:16.331324 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-bb5e22b1-774e-49cb-ac49-ea5dc9a6b072 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:16.331833 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-bb5e22b1-774e-49cb-ac49-ea5dc9a6b072 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:16.332553 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-bb5e22b1-774e-49cb-ac49-ea5dc9a6b072 admin admin] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:16.333035 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-bb5e22b1-774e-49cb-ac49-ea5dc9a6b072 admin admin] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:16.333654 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-bb5e22b1-774e-49cb-ac49-ea5dc9a6b072 admin admin] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:16.354423 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-bb5e22b1-774e-49cb-ac49-ea5dc9a6b072 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.080761 Sep 17 21:02:16.354971 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 17 21:02:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:02:27.843255 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-09fd4e49-995f-4dd3-b09f-5d2705877b84 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:27.844265 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-09fd4e49-995f-4dd3-b09f-5d2705877b84 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 17 21:02:27.844658 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 17 21:02:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:27.988284 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writing DB stats nova_cell0:SELECT=4 {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:27.989028 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writing DB stats nova_cell1:SELECT=4 {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:27.989698 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG dbcounter [-] [105600] Writing DB stats nova_api:SELECT=8 {{(pid=105600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:28.038513 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-57b643c5-b097-43bc-a6ab-0547327e0470 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:28.041928 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-57b643c5-b097-43bc-a6ab-0547327e0470 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:28.042399 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-57b643c5-b097-43bc-a6ab-0547327e0470 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:28.042825 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-57b643c5-b097-43bc-a6ab-0547327e0470 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:28.043538 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-57b643c5-b097-43bc-a6ab-0547327e0470 admin admin] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:28.043985 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-57b643c5-b097-43bc-a6ab-0547327e0470 admin admin] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:28.044453 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-57b643c5-b097-43bc-a6ab-0547327e0470 admin admin] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:28.069873 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-57b643c5-b097-43bc-a6ab-0547327e0470 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085827 Sep 17 21:02:28.070358 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 17 21:02:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:29.157595 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG nova.api.openstack.wsgi [None req-09fd4e49-995f-4dd3-b09f-5d2705877b84 admin admin] Calling method '>' {{(pid=105601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:29.158601 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: INFO nova.api.openstack.requestlog [None req-09fd4e49-995f-4dd3-b09f-5d2705877b84 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 17 21:02:29.159013 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: [pid: 105601|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 17 21:02:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:29.348981 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG nova.api.openstack.wsgi [None req-7320b664-5311-42e0-a3e6-b2225dcd62d5 admin admin] Calling method '>' {{(pid=105600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:29.352400 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-7320b664-5311-42e0-a3e6-b2225dcd62d5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:29.352914 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-7320b664-5311-42e0-a3e6-b2225dcd62d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:29.353348 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-7320b664-5311-42e0-a3e6-b2225dcd62d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:29.354101 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-7320b664-5311-42e0-a3e6-b2225dcd62d5 admin admin] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:29.354553 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-7320b664-5311-42e0-a3e6-b2225dcd62d5 admin admin] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:29.354974 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: DEBUG oslo_concurrency.lockutils [None req-7320b664-5311-42e0-a3e6-b2225dcd62d5 admin admin] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:29.377895 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: INFO nova.api.openstack.requestlog [None req-7320b664-5311-42e0-a3e6-b2225dcd62d5 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079240 Sep 17 21:02:29.378388 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: [pid: 105600|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 17 21:02:29 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:27.229803 dv-cinder-826510-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 17 21:03:27.230335 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: Sat Sep 17 21:03:27 2022 - graceful shutdown triggered... Sep 17 21:03:27.230774 dv-cinder-826510-9-iscsi devstack@n-api.service[105600]: Gracefully killing worker 1 (pid: 105600)... Sep 17 21:03:27.231842 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: Gracefully killing worker 2 (pid: 105601)... Sep 17 21:03:27.359335 dv-cinder-826510-9-iscsi devstack@n-api.service[105601]: DEBUG dbcounter [-] [105601] Writing DB stats nova_api:SELECT=4 {{(pid=105601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:28.230905 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: worker 1 buried after 1 seconds Sep 17 21:03:28.231519 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: worker 2 buried after 1 seconds Sep 17 21:03:28.231519 dv-cinder-826510-9-iscsi devstack@n-api.service[105599]: goodbye to uWSGI. Sep 17 21:03:28.232700 dv-cinder-826510-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 17 21:03:28.233246 dv-cinder-826510-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 17 21:03:28.236019 dv-cinder-826510-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 17 21:03:28.245517 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 17 21:03:28.247963 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 17 21:03:28 2022] *** Sep 17 21:03:28.247963 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 17 21:03:28.247963 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 17 21:03:28.247963 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: nodename: dv-cinder-826510-9-iscsi Sep 17 21:03:28.247963 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: machine: x86_64 Sep 17 21:03:28.247963 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: clock source: unix Sep 17 21:03:28.247963 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: pcre jit disabled Sep 17 21:03:28.247963 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: detected number of CPU cores: 4 Sep 17 21:03:28.247963 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: current working directory: / Sep 17 21:03:28.247963 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: detected binary path: /usr/bin/uwsgi-core Sep 17 21:03:28.247963 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: your processes number limit is 47680 Sep 17 21:03:28.248930 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: your memory page size is 4096 bytes Sep 17 21:03:28.248930 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: detected max file descriptor number: 2048 Sep 17 21:03:28.248930 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: lock engine: pthread robust mutexes Sep 17 21:03:28.248930 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: thunder lock: enabled Sep 17 21:03:28.248930 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 17 21:03:28.248930 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 17 21:03:28.287703 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: Python main interpreter initialized at 0x55764fc999c0 Sep 17 21:03:28.287703 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: python threads support enabled Sep 17 21:03:28.287703 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: your server socket listen backlog is limited to 100 connections Sep 17 21:03:28.287703 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: your mercy for graceful operations on workers is 90 seconds Sep 17 21:03:28.288117 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: mapped 403077 bytes (393 KB) for 2 cores Sep 17 21:03:28.288117 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: *** Operational MODE: preforking *** Sep 17 21:03:28.288381 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: *** uWSGI is running in multiple interpreter mode *** Sep 17 21:03:28.288381 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: spawned uWSGI master process (pid: 120576) Sep 17 21:03:28.288587 dv-cinder-826510-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 17 21:03:28.292696 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: spawned uWSGI worker 1 (pid: 120587, cores: 1) Sep 17 21:03:28.292696 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: spawned uWSGI worker 2 (pid: 120588, cores: 1) Sep 17 21:03:28.292696 dv-cinder-826510-9-iscsi devstack@n-api.service[120576]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 17 21:03:28.973162 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 17 21:03:28.986305 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 17 21:03:30.148451 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 21:03:30.148451 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: from cryptography.utils import int_from_bytes Sep 17 21:03:30.149172 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 21:03:30.149172 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: from cryptography.utils import int_from_bytes Sep 17 21:03:30.180696 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 21:03:30.180696 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: from cryptography.utils import int_from_bytes Sep 17 21:03:30.181280 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 21:03:30.181280 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: from cryptography.utils import int_from_bytes Sep 17 21:03:32.610025 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 21:03:32.610569 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 21:03:32.610749 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 21:03:32.611125 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 21:03:32.611384 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 21:03:32.611779 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.612113 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.612439 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.612790 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.613126 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.613444 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.613771 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.614095 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.614429 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.614696 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.615016 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.615492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826510-9-iscsi {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.615823 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.616140 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.616459 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.616809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.617125 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.617453 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.617765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.618274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.619716 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.619716 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.619716 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.619716 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.620034 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.620279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.620627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.620955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.621282 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.621626 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.622040 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826510-9-iscsi {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.622364 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.622688 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.623009 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.623424 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.623740 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.624056 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.624382 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.624735 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.625056 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.625407 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.625730 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.626089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.626372 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.626677 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.626996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.627315 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.627811 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.628292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.628613 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.628902 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.629221 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.629556 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.629894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.630226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.630488 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.630747 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.631073 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.631402 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.631719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.632033 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.632348 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.632659 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.632996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.633310 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.633624 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.633939 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.634267 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.634591 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.634920 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.635235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.635560 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.635966 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.636225 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.636538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.636912 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.637269 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.637588 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.637917 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.638246 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.638560 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.638873 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.639186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.639512 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.639859 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.640171 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.640430 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.640811 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.641072 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.641399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.641714 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.642027 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.642340 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.642647 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.642961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.643275 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.643586 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.643898 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.644209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.644521 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.644859 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.645173 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.645484 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.645794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.646120 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.646449 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.646761 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.647073 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.647385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.647697 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.648025 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.648337 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.648650 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.649005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.649316 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.649628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.649958 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.650272 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.650584 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.650922 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.651216 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.651528 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.651857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.652172 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.652486 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.653355 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.653834 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.654154 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.654472 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.654786 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.655100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.655412 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.655750 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.656084 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.656405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.657312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.657312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.657653 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.657814 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.658053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.658406 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.658797 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.659070 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.659413 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.659742 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.660066 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.660397 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.660764 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.661092 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.661413 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.661738 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.662067 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.662397 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.662741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.663068 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.663392 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.663720 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.664041 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.664370 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.664735 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.665073 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.665397 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.665753 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.666114 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.666438 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.666774 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.667112 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.667437 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.667759 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.668079 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.668473 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.669438 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.669671 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.670002 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.670330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.670664 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.670988 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.671311 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.671630 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.671950 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.672269 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.672623 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.673002 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.673339 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.673667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.673989 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.674318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.674639 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.674957 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.675277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.675592 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.675904 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.676218 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.676538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.677339 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.677339 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.677676 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.677838 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.678173 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.678489 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.678810 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.679131 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.679558 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.679764 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.680097 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.680418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.680768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.681111 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.681434 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.681746 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.682084 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.682401 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.682717 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.683045 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.683366 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.683684 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.684004 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.684365 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.684729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.685054 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.685498 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.685853 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.686198 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.686516 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.687277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.687277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.687569 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.687788 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.688109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.688425 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.688857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.689086 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.689407 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.689932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.690097 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.690336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.690702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.691094 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.691569 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.691764 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.692079 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.692394 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.692739 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.693103 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.693418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.693780 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.694130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.694466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.694802 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.695127 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.695453 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.695774 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.696096 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.696419 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.696766 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.697098 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.697420 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.698003 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.698326 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.698668 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.699052 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.699315 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.699636 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.700170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.700548 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.700937 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.701261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.701724 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.701924 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.702251 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.702573 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.702899 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.703212 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.703532 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.703860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.704181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.704510 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.705004 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.705266 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.705605 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.706024 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.706343 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.706669 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.707012 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.707358 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.707679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.708000 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.708330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.708651 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.708998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.709324 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.709640 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.709970 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.710289 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.710614 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.710934 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.711252 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.711565 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.711888 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.712207 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.712522 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.712861 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.713182 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.713521 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.713839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.714170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.714502 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.714817 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.715131 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.716186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.716468 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.716807 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.717126 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.717441 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.717799 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.718121 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.718435 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.718764 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.719097 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.719422 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.719754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.720084 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.720404 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.720844 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.721410 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.721733 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.722054 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.722372 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.723170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.723170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.723369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.723627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.723947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.724262 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.724583 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.725011 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.725679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.726025 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.726351 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.726698 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.727255 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.727379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.727723 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.728059 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.728379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.728728 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.729040 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.729356 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.729673 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.730000 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.730495 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.730857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.731848 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.732351 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.732964 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.733437 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.733775 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.734181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.734515 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.734833 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.735159 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.735475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.735842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.736132 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.736447 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.736791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.737109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.737464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.737782 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.738137 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.738476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.738830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.739148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.739464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.739797 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.740116 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.740430 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.740779 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.741101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.741419 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.741732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.742592 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.742592 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.742851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.742978 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.743267 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.743584 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.743896 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.744220 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.744538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.744883 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.745196 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.745514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.745833 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.746146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.746462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.746825 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.747154 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.747593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.747874 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.748194 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.748516 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.748863 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.749183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.749516 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.749843 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.750158 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.750472 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.750790 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.751103 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.751415 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.751733 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.752102 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.752407 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 21:03:32.754713 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.757000 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 21:03:32.757111 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.757216 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 21:03:32.757305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.757389 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 21:03:32.757488 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.757585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 21:03:32.757677 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.757677 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.757847 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.758052 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.758147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.758245 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.758338 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.758429 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.758525 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.758616 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.758700 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.758788 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.758870 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.758961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.759044 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.759125 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.759207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.759287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.759376 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.759467 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.759551 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.759642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.759734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.759826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.759918 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826510-9-iscsi {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.760092 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.760184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.760274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.760357 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.760446 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.760539 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.760623 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.760753 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.760841 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.760923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.761013 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.761096 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.761192 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.761275 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.761454 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.761454 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.761624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.761717 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.761810 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.761893 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.761983 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.761983 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.762182 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.762182 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.762359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.762444 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.762541 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.762625 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.762706 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.762796 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.762888 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.762977 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.763064 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.763134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.763380 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.763494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.763586 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.763669 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.763983 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826510-9-iscsi {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.764078 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.764293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.764384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.764610 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.764736 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.764959 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.765059 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.765279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.765377 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.765599 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.765691 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.765918 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.766009 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.766237 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.766327 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.766557 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.766648 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.766879 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.767005 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.767198 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.767301 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.767515 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.767613 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.767832 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.767928 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.768153 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.768259 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.768472 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.768583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.768834 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.768942 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.769155 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.769328 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.769483 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.769598 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.769799 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.769898 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.770115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.770218 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.770376 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.770466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.770693 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.770791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.771026 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.771130 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.771351 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.771471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.771681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.771781 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.771942 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.772092 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.772203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.772406 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.772529 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.772760 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.772873 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.773086 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.773177 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.773439 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.773542 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.773729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.773833 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.774041 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.774137 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.774386 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.774490 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.774702 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.774798 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.775015 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.775110 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.775328 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.775432 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.775653 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.775756 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.775974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.776137 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.776279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.776428 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.776605 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.776837 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.776979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.777120 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.777306 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.777468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.777611 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.777752 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.778521 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.778686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.778847 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.779142 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.779292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.779483 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.779633 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.779810 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.779966 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.780148 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.780333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.780477 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.780618 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.780816 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.780908 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.781113 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.781216 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.781431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.781549 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.781762 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.781869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.782108 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.782200 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.782422 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.782514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.782681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.782805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.782993 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.783127 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.783307 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.783539 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.783643 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.783806 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.783979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.784131 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.784274 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.784423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.784565 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.784753 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.784911 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.785072 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.785224 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.785401 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.785581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.785855 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.786009 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.786156 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.786304 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.786453 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.786608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.786758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.786908 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.787059 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.787211 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.787354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.787504 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.787647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.787796 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.787946 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.788096 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.788237 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.788390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.788538 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.788721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.788882 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.789025 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.789176 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.789326 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.789476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.789625 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.789779 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.789929 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.790070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.790219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.790368 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.790523 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.790672 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.790827 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.790979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.791131 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.791273 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.791423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.791586 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.791737 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.791886 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.792027 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.792168 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.792324 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.792473 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.792639 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.792898 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.793157 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.793386 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.794358 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.794619 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.794794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.794940 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.795083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.795271 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.795425 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.795569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.795729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.795942 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.796087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.796251 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.796394 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.796536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.796695 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.796843 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.796984 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.797142 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.797292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.797435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.797590 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.797739 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.797900 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.798056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.798215 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.798363 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.798524 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.798675 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.798830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.798985 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.799133 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.799287 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.799442 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.799599 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 21:03:32.799762 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.799910 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.800067 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.800214 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.800369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.800523 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.800710 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.800871 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.801052 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.801325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.801504 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.801666 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.801823 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.801972 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.802126 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.802289 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.802445 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.802667 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.802819 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.803409 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.803635 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.803798 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.803956 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.804118 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.804417 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.804654 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.804839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.805000 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.805161 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.805324 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.805473 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.805473 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.805762 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.805919 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.806077 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.806226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.806381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.806381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.806671 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.806827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.807001 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.807152 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.807307 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.807463 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.807619 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.807774 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.807930 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.808080 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.808227 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.808227 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.808514 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.808662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.808865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.809059 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.809214 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.809369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.809518 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.809675 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.809824 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.809978 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.810127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.810282 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.810437 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.810659 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.810818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.810976 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.811144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.811367 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.811532 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.811532 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.811824 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.811979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.812127 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.812285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.812434 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.812596 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.812779 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.812938 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.813414 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.813582 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.813835 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.813996 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.814145 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.814294 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.814472 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.814622 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.814779 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.814928 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.815077 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.815236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.815385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.815545 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.815702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.815850 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.816004 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.816154 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.816308 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.816468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.816624 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.816838 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.816995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.817151 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.817306 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.817470 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.817636 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.817793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.817956 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.818105 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.818253 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.818413 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.818413 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.818701 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.818856 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.819005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.819005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.819295 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.819451 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.819600 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.819753 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.819900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.820060 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.820209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.820363 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.820511 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.820659 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.820852 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.821016 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.821164 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.821321 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.821478 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.821626 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.821788 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.821950 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.822099 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.822253 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.822401 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.822401 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.822957 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.823112 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.823273 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.823556 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.823732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.823974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.824138 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.824301 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.824458 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.824607 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.824917 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.825147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.825314 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.825504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.825661 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.825811 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.825982 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.826141 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.826290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.826437 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.826437 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.826726 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.826726 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.827017 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.827166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.827321 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.827476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.827633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.827828 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.828255 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.828411 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.828559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.828751 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.828913 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.829063 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.829228 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.829385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.829540 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.829689 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.829843 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.830006 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.830006 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.830306 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.830306 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.830597 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.830745 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.830919 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.831069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.831217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.831365 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.831511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.831666 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.831828 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.831976 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.831976 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.832269 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.832416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.832564 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.832758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.832913 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.833069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.833226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.833382 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.833684 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.833845 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.834012 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.834241 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.834405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.834568 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.834727 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.834883 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.835031 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.835179 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.835328 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.835475 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.835632 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.835780 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.835944 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.835944 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.836313 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.836481 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.836643 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.836890 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.837047 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.837195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.837343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.837504 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.837661 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.837818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.837966 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.838121 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.838269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.838429 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.838596 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.838752 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.838907 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.839055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.839202 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.839358 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.839507 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.839654 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.839815 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.839972 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.840127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.840838 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.841069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.841282 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.841448 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.841599 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.841824 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.841983 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.842132 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.842280 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.842427 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.842576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.842737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.842886 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.843040 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.843208 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.843365 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.843522 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.843822 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.843975 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.843975 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.844386 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.844540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.844738 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.844905 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.845355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.845512 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.845660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.845819 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.845967 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.846124 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.846279 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.846436 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.846639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.846797 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.846959 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.846959 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.847247 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.847396 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.847544 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.847691 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.847870 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.848020 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.848175 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.848323 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.848470 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.848625 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.848819 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.848972 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.849119 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.849266 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.849414 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.849569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.849731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.849899 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.850054 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.850203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.850351 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.850507 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.850664 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.850819 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.850996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.851153 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.851319 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.851476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.851626 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.851792 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.851947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.852104 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.852259 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.852426 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.852584 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.852771 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.852936 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.853095 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.853243 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.853399 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.853555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.853703 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.854017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.854183 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.854572 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.854729 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.854884 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.855034 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.855192 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.855348 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.855510 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.855666 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.855816 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.856517 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.856719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.856875 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.857033 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.857182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.857331 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.857477 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.857639 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.857788 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.857943 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.858091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.858239 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.858387 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.858543 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.858702 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.858850 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.859013 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.859161 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.859317 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.859474 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.859630 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.859785 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.859941 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.860466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.860642 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.860838 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.860998 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.861166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.861325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.861482 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.861640 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.861796 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.861944 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.862092 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.862247 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.862405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.862564 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.862722 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.862877 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.863037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.863187 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.863348 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.863497 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.863645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.863799 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.864063 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.864225 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.864384 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.864707 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.864866 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.865014 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.865172 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.865332 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.865557 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.865718 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.865874 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.866030 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.866186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.866347 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.866505 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.866653 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.866809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.866957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.867105 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.867277 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.867434 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.867588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.867738 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.867738 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.868018 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.868174 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.868323 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.868478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.868625 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.868829 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.868989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.869151 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.869310 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.869459 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.869625 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.869774 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.869929 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.870078 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.870078 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.870359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.870520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.870676 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.870826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.870974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.871128 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.871297 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.871460 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.871676 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.871827 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.871983 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.872139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.872295 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.872457 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.872612 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.872792 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.872953 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.873102 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.873263 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.873424 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.873572 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.873728 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.873883 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.874050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.874277 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.874277 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.874571 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.874879 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.875039 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.875196 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.875353 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.875512 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.875667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.875667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.875956 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.876106 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.876262 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.876419 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.876590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.876780 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.876933 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.877094 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.877251 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.877408 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.877568 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.877716 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.877871 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.878034 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.878190 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.878340 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.878495 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.878644 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.878791 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.878953 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.879110 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.879268 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.879423 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.879589 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.879751 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.879908 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.880056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.880212 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.880361 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.880509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.880665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.880852 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.881011 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.881175 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.881335 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.881507 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.881665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.881813 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.881961 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.882115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.882263 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.882421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.882569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.882717 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.882864 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.883012 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.883159 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.883315 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.883481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.883631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.883788 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.883944 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.884099 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.884279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.884505 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.884659 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.884992 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.885151 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.885300 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.885458 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.885618 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.885775 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.885923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.886078 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.886239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.886396 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.886552 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.886710 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.886873 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.887022 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.887703 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.887869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.888019 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.888187 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.888337 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.888492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.888651 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.888859 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.889016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.889166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 21:03:32.889314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.889314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.889314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.889314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.889314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.889314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.889314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.889314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.890431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.890431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.890431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.890431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.890431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.890431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.890431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.890431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.891559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.891559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.891559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.891559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.891559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.892303 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.892303 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.892581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.892806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.893145 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.893466 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.893842 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.894413 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.894815 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.895382 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.895655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.895904 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.896143 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.896452 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.896800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.897119 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.897440 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.897765 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.898083 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.898410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.898728 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.899049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.899360 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.899671 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.899998 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.900316 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.900634 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.900998 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.901329 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.901659 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.901970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.902287 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.902605 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.903615 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.904209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.904542 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.904895 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.905225 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.905554 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.905880 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.906200 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.906520 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.906845 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.907166 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.907484 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.907821 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.908146 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.908462 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.908805 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.909123 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.909443 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.909758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.910202 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.910522 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.910841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.911155 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.911476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.911795 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.912118 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.912441 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.912776 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.913206 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.913526 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.913845 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.914165 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.914477 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.914790 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.915108 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.915441 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.915754 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.916067 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.916379 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.916730 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.917045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.917374 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.917800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.918128 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.918469 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.919158 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.919484 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.919806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.920141 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.920474 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.920832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.921151 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.921476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.921801 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.922137 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.922471 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.922793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.923118 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.923434 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.923768 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.924099 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.924422 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.924786 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.925218 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.925573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.925877 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.926209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.926553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.926860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.927178 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.927498 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.927818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.928134 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.928475 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.928807 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.929133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.929450 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.929768 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.930084 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.930396 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.930729 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.931041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.931372 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.931695 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.932027 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.932357 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.932699 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.933026 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.933344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.933659 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.933972 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.934425 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.934963 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.935281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.935617 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.935960 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.936363 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.936613 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.936983 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.937323 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.937652 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.937980 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.938308 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.938641 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.938958 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.939273 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.939590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.939904 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.940218 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.940531 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.940880 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.941195 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.941509 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.941820 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.942155 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.942473 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.942805 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.943126 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.943443 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.943760 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.944075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.944430 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.944763 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.945102 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.945424 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.945759 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.946088 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.946411 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.946838 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.947054 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.947186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO dbcounter [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Registered counter for database nova_api Sep 17 21:03:32.947376 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.947948 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.948281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.948599 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.948951 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.949272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.949601 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.951029 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.951388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.951724 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.952056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.952385 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.952734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.953064 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.953394 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.953719 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.954046 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.954371 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.954716 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.955051 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.955390 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.955818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.956108 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.956397 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.956749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.957079 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.957448 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.957775 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.958102 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.958430 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.958759 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.959088 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.959411 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.959734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.960062 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.960387 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.960734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.961057 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.961382 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.961706 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.962043 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.962389 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.962723 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.963979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.963979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.963979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.964414 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.964533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.964884 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.965225 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.966255 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.966837 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.967180 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.967527 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.967962 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.968182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.968508 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.968859 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.969071 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_db.sqlalchemy.engines [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 21:03:32.969166 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.969506 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.969831 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.970149 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.970481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.970804 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.971367 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.971728 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.972059 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.972402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.972763 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.973096 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.973416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.973753 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.974074 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.974392 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.974722 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.975047 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.975363 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.975506 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writer thread running {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 21:03:32.975681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.976005 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.976328 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.976642 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.976983 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.977300 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.977637 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.977957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.978274 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.978589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.978912 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.979228 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.979542 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.979859 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.980174 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.980496 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.980842 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.981454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.981923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.982254 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.982628 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.982953 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.983273 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.983611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.983928 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.984245 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.984575 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.984923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.985262 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.985592 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.985914 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.986603 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.987148 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.987494 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.987826 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.988243 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.988518 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.988860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.989179 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.989494 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.989829 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.990150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.990473 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.990793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.991111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.991430 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.991749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.992069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.992390 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.992726 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.993049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.993369 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.993687 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.994006 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.994325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.994648 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.995000 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.995329 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.995655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.995981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.996304 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.996655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.997235 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.997567 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.997893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.998227 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.998573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.998896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.999214 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.999650 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:32.999973 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.000303 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.000632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.000977 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.001312 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.001644 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.001963 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.002293 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.002613 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.002952 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.003298 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.003635 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.003968 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.004283 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.004597 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.004936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.005254 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.005580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.005899 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.006215 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.006528 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.006847 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.007160 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.007474 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.007787 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.008107 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.008423 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.008757 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.009068 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.009380 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.009691 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.009999 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.010313 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.010630 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.010942 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.011255 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.011564 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.011874 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.012712 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.013285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.013765 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.014101 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.014441 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.014767 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.015104 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.015429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.015764 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.016096 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.016425 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.016821 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.017114 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.017436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.017763 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.018085 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.018408 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.018738 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.019056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.019391 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.019726 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.020044 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.020383 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.020731 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.021064 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.021396 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.021714 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.022056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.022377 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.022698 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.023020 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.023342 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.023661 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.023985 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.024304 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.024623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.024975 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.025303 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.025640 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.025973 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.026292 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.026629 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.026966 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.027320 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.027641 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.028898 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.029324 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.029662 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.029990 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.030436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 21:03:33.030591 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 21:03:33.033793 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.context [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e02f9b70-dae4-46dc-9136-6abdbb093c64(cell1) {{(pid=120587) load_cells /opt/stack/nova/nova/context.py:464}} Sep 17 21:03:33.037818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:33.038299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:33.039865 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:33.040596 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:33.041090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:33.043099 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:33.045279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO dbcounter [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Registered counter for database nova_cell0 Sep 17 21:03:33.049378 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO dbcounter [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Registered counter for database nova_cell1 Sep 17 21:03:33.056721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_db.sqlalchemy.engines [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 21:03:33.061393 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_db.sqlalchemy.engines [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 21:03:33.069309 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writer thread running {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 21:03:33.069647 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writer thread running {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 21:03:33.095330 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO dbcounter [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Registered counter for database nova_api Sep 17 21:03:33.118686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 21:03:33.126035 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 21:03:33.187860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.context [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e02f9b70-dae4-46dc-9136-6abdbb093c64(cell1) {{(pid=120588) load_cells /opt/stack/nova/nova/context.py:464}} Sep 17 21:03:33.192264 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:33.192854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:33.194736 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:33.195580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:33.196069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:33.198432 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:33.201461 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO dbcounter [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Registered counter for database nova_cell0 Sep 17 21:03:33.207151 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO dbcounter [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Registered counter for database nova_cell1 Sep 17 21:03:33.214902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 21:03:33.218522 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 21:03:33.223507 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO dbcounter [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Registered counter for database nova_cell0 Sep 17 21:03:33.225815 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 21:03:33.225815 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 21:03:33.230416 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_db.sqlalchemy.engines [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 21:03:33.235230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writer thread running {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 21:03:33.388780 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO dbcounter [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Registered counter for database nova_cell0 Sep 17 21:03:33.398261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 21:03:33.402954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 21:03:33.559336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: WARNING keystonemiddleware.auth_token [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 21:03:33.566842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: WARNING keystonemiddleware.auth_token [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 21:03:33.737157 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 21:03:33.744951 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 21:03:33.912798 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: WARNING keystonemiddleware.auth_token [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 21:03:33.919173 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: WARNING keystonemiddleware.auth_token [None req-cbd7c324-c666-4317-b8ec-93bd9f2af15f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 21:03:33.924736 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55764fc999c0 pid: 120587 (default app) Sep 17 21:03:34.102303 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 21:03:34.108655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-244813a4-199c-4089-a5ab-daa23f0ba6b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 21:03:34.113982 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55764fc999c0 pid: 120588 (default app) Sep 17 21:04:10.741784 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:10.742669 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:10.743534 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:10.744356 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:12.143576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-39ab9e43-17ad-4e86-a3d1-d0a95b578397 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] Action: 'create', calling method: .version_select at 0x7f9ba848d430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1784871594", "metadata": {"Type": "work"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:12.987845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-39ab9e43-17ad-4e86-a3d1-d0a95b578397 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.258479 Sep 17 21:04:12.989085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Sep 17 21:04:10 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2261 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 17 21:04:13.347715 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e66fa74-e203-43d3-ac39-61f270789345 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] Calling method '.version_select at 0x7f9ba8538f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:13.413715 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:13.414992 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:13.416490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:13.417787 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:13.851462 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e66fa74-e203-43d3-ac39-61f270789345 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34" status: 200 len: 353 microversion: 2.1 time: 0.849051 Sep 17 21:04:13.852064 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1/2] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:04:12 2022] GET /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34 => generated 353 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:04:14.617375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f9b4dfc2-220f-41da-851a-fd0a7baf0393 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] Calling method '.version_select at 0x7f9ba835f310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:14.698432 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f9b4dfc2-220f-41da-851a-fd0a7baf0393 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4404c0be-93e9-4621-924a-1816d8358b06" status: 200 len: 351 microversion: 2.1 time: 0.084132 Sep 17 21:04:14.703064 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:04:14 2022] GET /compute/v2.1/os-volumes/4404c0be-93e9-4621-924a-1816d8358b06 => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:14.866885 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0e208dae-179e-43ee-8997-fe6c12d01cf8 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] Calling method '.version_select at 0x7f9ba834d3a0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:14.947176 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0e208dae-179e-43ee-8997-fe6c12d01cf8 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34" status: 200 len: 354 microversion: 2.1 time: 0.084252 Sep 17 21:04:14.948186 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:04:14 2022] GET /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:14.964950 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7237b944-8f00-4272-b468-083b93b5cc73 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] Calling method '.version_select at 0x7f9ba835fa60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:15.023942 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7237b944-8f00-4272-b468-083b93b5cc73 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34" status: 200 len: 354 microversion: 2.1 time: 0.062724 Sep 17 21:04:15.024657 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:04:14 2022] GET /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34 => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:15.045257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c097f342-c3f9-4375-b1ae-e12a0b0ec0ca tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] Calling method '.version_select at 0x7f9ba834d550>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:15.238871 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c097f342-c3f9-4375-b1ae-e12a0b0ec0ca tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34" status: 202 len: 0 microversion: 2.1 time: 0.198617 Sep 17 21:04:15.247495 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 17 21:04:15 2022] DELETE /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:04:15.250653 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-02dc5534-c287-4887-8fe2-e4fb825e3bce tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] Calling method '.version_select at 0x7f9ba82f7160>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:15.337618 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-02dc5534-c287-4887-8fe2-e4fb825e3bce tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34" status: 200 len: 353 microversion: 2.1 time: 0.093076 Sep 17 21:04:15.346600 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:04:15 2022] GET /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:16.355560 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5223ba2-efdd-47f5-a4e4-0eefa02cfbc6 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] Calling method '.version_select at 0x7f9ba834daf0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:16.419771 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-a5223ba2-efdd-47f5-a4e4-0eefa02cfbc6 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] HTTP exception thrown: Volume 062d4d64-cde9-4507-aa35-befdb6933d34 could not be found. Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5223ba2-efdd-47f5-a4e4-0eefa02cfbc6 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] Request method failure captured: Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34 HTTP/1.1 Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZKIw4oDTJHupIrLRyAJ7p9Xiv67PnbE8Mk7NZ31z1MMaaBuDciGeI91kDtBBfxrLGXzbicTg26EmUGLRJ1coYaPD63KBcYBS2Zh6AgbETXsMINkrDL-H7VIAsgbR4oM56SyeAiIszAIYsMGzZsDTPPHbUvwB062-eNiQ7cS65x1v4 Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: 9cdcf03c8c5e456b8f8ea08564ad6c94 Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesGetTestJSON-1047575569 Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:04:16.436533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9cdcf03c8c5e456b8f8ea08564ad6c94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9cdcf03c8c5e456b8f8ea08564ad6c94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9cdcf03c8c5e456b8f8ea08564ad6c94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9cdcf03c8c5e456b8f8ea08564ad6c94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesGetTestJSON-1047575569 Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 9cdcf03c8c5e456b8f8ea08564ad6c94 Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesGetTestJSON-1047575569 Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesGetTestJSON-1047575569-project Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: dc3465a68b04477193d6c88130dab151 Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesGetTestJSON-1047575569-project Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Volume 062d4d64-cde9-4507-aa35-befdb6933d34 could not be found. Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '062d4d64-cde9-4507-aa35-befdb6933d34'} Sep 17 21:04:16.437813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 062d4d64-cde9-4507-aa35-befdb6933d34 could not be found. (HTTP 404) (Request-ID: req-ca2f2fab-993d-4a00-8913-1ffc7fa86607) Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:16.438590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:04:16.439647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 062d4d64-cde9-4507-aa35-befdb6933d34 could not be found. Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 17 21:04:16.441070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:16.442832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 062d4d64-cde9-4507-aa35-befdb6933d34 could not be found. Sep 17 21:04:16.442832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:04:16.442832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:16.442832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:04:16.442832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:16.442832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:16.442832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:16.442832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:16.442832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:16.442832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 062d4d64-cde9-4507-aa35-befdb6933d34 could not be found. Sep 17 21:04:16.442832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:04:16.446455 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5223ba2-efdd-47f5-a4e4-0eefa02cfbc6 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] Returning 404 to user: Volume 062d4d64-cde9-4507-aa35-befdb6933d34 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:16.448353 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a5223ba2-efdd-47f5-a4e4-0eefa02cfbc6 tempest-VolumesGetTestJSON-1047575569 tempest-VolumesGetTestJSON-1047575569-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34" status: 404 len: 109 microversion: 2.1 time: 0.097834 Sep 17 21:04:16.452396 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:04:16 2022] GET /compute/v2.1/os-volumes/062d4d64-cde9-4507-aa35-befdb6933d34 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:16.644371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c8f231c-8cc1-4a9b-ac19-da515b5149c0 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] Calling method '.version_select at 0x7f9ba835fd30>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:16.776291 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c8f231c-8cc1-4a9b-ac19-da515b5149c0 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/19d6e317-044f-4eb6-ab49-d3bf6f255422" status: 200 len: 351 microversion: 2.1 time: 0.134721 Sep 17 21:04:16.785046 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 5/9] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:04:16 2022] GET /compute/v2.1/os-volumes/19d6e317-044f-4eb6-ab49-d3bf6f255422 => generated 351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:18.782525 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c48dbc5c-c73e-4f53-b449-193e1e51036f tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] Calling method '.version_select at 0x7f9ba8365b80>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:18.971343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c48dbc5c-c73e-4f53-b449-193e1e51036f tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/52cc9a64-ecc4-42dd-b6f7-b95c08256b01" status: 200 len: 351 microversion: 2.1 time: 0.192871 Sep 17 21:04:18.974509 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 5/10] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:04:18 2022] GET /compute/v2.1/os-volumes/52cc9a64-ecc4-42dd-b6f7-b95c08256b01 => generated 351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:18.985959 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-69603cf5-d484-4d17-9df3-90a6d6818fb7 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] Calling method '.version_select at 0x7f9ba835f5e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:19.196876 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-69603cf5-d484-4d17-9df3-90a6d6818fb7 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.214829 Sep 17 21:04:19.199210 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 6/11] 10.222.0.16 () {58 vars in 1134 bytes} [Sat Sep 17 21:04:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:19.227359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c97bdd7-c0a2-4726-be89-ceaaf367ef3f tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] Calling method '.version_select at 0x7f9ba82c1280>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:19.399618 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c97bdd7-c0a2-4726-be89-ceaaf367ef3f tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.186528 Sep 17 21:04:19.402789 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Sep 17 21:04:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:19.418252 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03271c69-69ca-4ff9-a8bc-f833eea5d152 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] Calling method '.version_select at 0x7f9ba82f7ca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:19.625824 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-03271c69-69ca-4ff9-a8bc-f833eea5d152 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.211396 Sep 17 21:04:19.628430 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1134 bytes} [Sat Sep 17 21:04:19 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:19.646151 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0987351f-55fa-4477-9dcc-b10568c433da tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] Calling method '.version_select at 0x7f9ba8365a60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:19.953457 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0987351f-55fa-4477-9dcc-b10568c433da tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.314977 Sep 17 21:04:19.954897 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 7/14] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Sep 17 21:04:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:19.971097 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8cfdd8c7-1b76-42b9-a46f-dc3f9d2f4dbe tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] Calling method '.version_select at 0x7f9ba835f4c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:20.190378 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8cfdd8c7-1b76-42b9-a46f-dc3f9d2f4dbe tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.224106 Sep 17 21:04:20.190940 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Sep 17 21:04:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:20.210262 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-587b5382-94e4-4d3e-8020-58a51a596ca1 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] Calling method '.version_select at 0x7f9ba82dbdc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:20.758585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-587b5382-94e4-4d3e-8020-58a51a596ca1 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.552192 Sep 17 21:04:20.759650 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 17 21:04:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:20.774786 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-023f73c3-12b4-447b-8316-bd73aada26a4 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] Calling method '.version_select at 0x7f9ba82f7700>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:21.029644 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-023f73c3-12b4-447b-8316-bd73aada26a4 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.259232 Sep 17 21:04:21.038946 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 9/17] 10.222.0.16 () {58 vars in 1188 bytes} [Sat Sep 17 21:04:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:21.047784 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b68cb5d9-5b1e-403c-bf93-48ec0feb6058 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] Calling method '.version_select at 0x7f9ba82c1ee0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:21.210531 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b68cb5d9-5b1e-403c-bf93-48ec0feb6058 tempest-VolumesTestJSON-1846998736 tempest-VolumesTestJSON-1846998736-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.169887 Sep 17 21:04:21.211610 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 9/18] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 17 21:04:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:27.562669 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1736559119", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:27.854354 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] validate_networks() for [('676f4f8e-4659-4332-b7d1-9e707434a08e', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:04:28.566375 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1240618555", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "networks": [{"uuid": "c62f5231-00ce-4cef-9e84-34821ff83586"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:28.878284 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] validate_networks() for [('c62f5231-00ce-4cef-9e84-34821ff83586', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:04:30.865776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:04:30.866806 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:04:30.867550 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:04:30.868143 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:04:30.868766 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:04:30.903872 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:30.904649 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:30.905315 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:30.906233 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:30.906863 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:30.907556 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:30.998364 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Getting quotas for project 1e42842c724f480f9cdd5ea75707b43f. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:31.013305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Getting quotas for user a3dac44116784a9e963a69e4793bac4b and project 1e42842c724f480f9cdd5ea75707b43f. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:31.044818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:04:31.048212 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:04:31.215704 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19d81fb9-33f9-452c-8d5e-c58463a3fbac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.345476 Sep 17 21:04:31.241856 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 10/19] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:04:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 4372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:04:31.356902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:04:31.357925 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:04:31.358560 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:04:31.359118 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:04:31.366617 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:04:31.419346 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:31.419855 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:31.423255 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:31.424220 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:31.427268 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:31.427896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:31.536788 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Getting quotas for project 43d4440dd2464bcb95e25ead37c5658a. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:31.564523 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Getting quotas for user 1fa4420540af41e4967b0f731f818af5 and project 43d4440dd2464bcb95e25ead37c5658a. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:31.631918 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:04:31.635971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:04:31.888639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26815cbf-0555-4e0b-a902-c6b343149809 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.951960 Sep 17 21:04:31.899467 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:04:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:04:32.082547 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7c93317-4956-4ed2-8812-281e5db02e19 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Action: 'create', calling method: .version_select at 0x7f9ba7a0d280>, body: {"keypair": {"name": "tempest-keypair-1014573676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4I4qdkMRdFWAdl3HTKuiQIb/p1ChyhhrggI/JGo9OCs0aWkxg3ASfnbnHbtqV0FW1TSDhDug1DDCzGCBEGjhs/Vmlf2M9F8t/TfMw+E6uzH6gxvhQXkUiFpYKfx3HbAw=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:32.117165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-e7c93317-4956-4ed2-8812-281e5db02e19 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Getting quotas for project aae15e7cf5d74f9f90e067bb801c7e95. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:32.123190 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-e7c93317-4956-4ed2-8812-281e5db02e19 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Getting quotas for user 4b5e98fb43a143ea8cfa30990b4fffc2 and project aae15e7cf5d74f9f90e067bb801c7e95. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:32.191448 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e7c93317-4956-4ed2-8812-281e5db02e19 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.943281 Sep 17 21:04:32.192807 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 11/21] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 17 21:04:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:32.202909 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fbf2649f-d373-47b2-98d8-39d1ba8a62ce tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:32.205483 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fbf2649f-d373-47b2-98d8-39d1ba8a62ce tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:32.410386 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-013a55f0-9e6f-4d3e-ac9e-68e13007ccd4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: .version_select at 0x7f9ba79e1160>, body: {"keypair": {"name": "tempest-keypair-1929499607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaYwUbOKm3z9gVPAGhrGDTdingI6e3JmOzwQliIMqOB3c1vPSZ8Ft/eeetwABv3D0VBZ3JwEs4IQthvS3t+KNCbAoPplKZKltG95qzeji4kM59zq/XGblVz7e2xm2035Q=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:32.503833 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-013a55f0-9e6f-4d3e-ac9e-68e13007ccd4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for project d9689fd1a04647cf91a73680e4b677d1. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:32.515180 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-013a55f0-9e6f-4d3e-ac9e-68e13007ccd4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for user 1e3b1e0f4888400b89c47b3e44443228 and project d9689fd1a04647cf91a73680e4b677d1. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:32.568432 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-013a55f0-9e6f-4d3e-ac9e-68e13007ccd4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.674213 Sep 17 21:04:32.578898 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 11/22] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 17 21:04:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:32.586969 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ace6997f-b3ed-4a29-a2ab-252ae801889d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:32.589219 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ace6997f-b3ed-4a29-a2ab-252ae801889d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:32.744582 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fbf2649f-d373-47b2-98d8-39d1ba8a62ce tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:32.773882 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fbf2649f-d373-47b2-98d8-39d1ba8a62ce tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1222 microversion: 2.1 time: 0.579615 Sep 17 21:04:32.776284 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:32 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1222 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:32.981989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ace6997f-b3ed-4a29-a2ab-252ae801889d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:33.037426 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ace6997f-b3ed-4a29-a2ab-252ae801889d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1215 microversion: 2.1 time: 0.447732 Sep 17 21:04:33.038105 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 12/24] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:32 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1215 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:33.153058 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-409489492", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:33.321668 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] validate_networks() for [('676f4f8e-4659-4332-b7d1-9e707434a08e', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:04:33.742013 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b57bb50-f97d-4855-a020-94742a61a372 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Action: 'create', calling method: .version_select at 0x7f9ba835fca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-181901703", "metadata": {"Type": "work"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b57bb50-f97d-4855-a020-94742a61a372 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Request method failure captured: Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 121 Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZfDCFbOIAws-GzTIXQoYRx60zDgK6PYEHE_g7Qj7cP7pQ3G9zWWHylZKayaFaBAs0PobCwEmcrDM2VPgZJlmDj7LuHBiy80PeC-9PE64T_M1bjZzAAKEwh5Jw4dxjdy7k6jewI7rvV0tlbg9p3oy7DWkECpS7EpM0fWiaarRsNiaU Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: acb8cf4cfdc242ef81676957e2b81a56 Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:04:33.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: acb8cf4cfdc242ef81676957e2b81a56 Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-1022028133-project Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 7b5cc9065d6e45398ceb0b8a77b4f8d3 Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-1022028133-project Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-181901703", "metadata": {"Type": "work"}}} Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: Sep 17 21:04:33.764386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-181901703', 'metadata': {'Type': 'work'}}}} Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi '#$%' Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:33.765526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:04:33.766642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:04:33.767624 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 17 21:04:33.767624 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.778234 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b57bb50-f97d-4855-a020-94742a61a372 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:33.779452 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b57bb50-f97d-4855-a020-94742a61a372 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.989082 Sep 17 21:04:33.797155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 13/25] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Sep 17 21:04:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1007 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:04:33.827058 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-359cfd28-b241-4436-af75-0a56d9c5f686 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Action: 'create', calling method: .version_select at 0x7f9ba8cb9a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-474859376", "metadata": {"Type": "work"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-359cfd28-b241-4436-af75-0a56d9c5f686 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Request method failure captured: Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 119 Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZfDCFbOIAws-GzTIXQoYRx60zDgK6PYEHE_g7Qj7cP7pQ3G9zWWHylZKayaFaBAs0PobCwEmcrDM2VPgZJlmDj7LuHBiy80PeC-9PE64T_M1bjZzAAKEwh5Jw4dxjdy7k6jewI7rvV0tlbg9p3oy7DWkECpS7EpM0fWiaarRsNiaU Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: acb8cf4cfdc242ef81676957e2b81a56 Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:04:33.846631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: acb8cf4cfdc242ef81676957e2b81a56 Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-1022028133-project Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 7b5cc9065d6e45398ceb0b8a77b4f8d3 Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-1022028133-project Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-474859376", "metadata": {"Type": "work"}}} Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: Sep 17 21:04:33.848409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-474859376', 'metadata': {'Type': 'work'}}}} Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi '0' Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:33.849183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:04:33.850213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:04:33.851239 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 17 21:04:33.851239 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.858576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-359cfd28-b241-4436-af75-0a56d9c5f686 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:33.859715 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-359cfd28-b241-4436-af75-0a56d9c5f686 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.052542 Sep 17 21:04:33.864798 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 14/26] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Sep 17 21:04:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:04:33.878034 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5839813-108a-4a26-b4c0-c6cb514f2cb1 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Action: 'create', calling method: .version_select at 0x7f9ba79950d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-175616193", "metadata": {"Type": "work"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5839813-108a-4a26-b4c0-c6cb514f2cb1 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Request method failure captured: Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 118 Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZfDCFbOIAws-GzTIXQoYRx60zDgK6PYEHE_g7Qj7cP7pQ3G9zWWHylZKayaFaBAs0PobCwEmcrDM2VPgZJlmDj7LuHBiy80PeC-9PE64T_M1bjZzAAKEwh5Jw4dxjdy7k6jewI7rvV0tlbg9p3oy7DWkECpS7EpM0fWiaarRsNiaU Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: acb8cf4cfdc242ef81676957e2b81a56 Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:04:33.903199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: acb8cf4cfdc242ef81676957e2b81a56 Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-1022028133-project Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 7b5cc9065d6e45398ceb0b8a77b4f8d3 Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-1022028133-project Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-175616193", "metadata": {"Type": "work"}}} Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: Sep 17 21:04:33.904385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-175616193', 'metadata': {'Type': 'work'}}}} Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi '' Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:33.905100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:04:33.906230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:04:33.907156 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 17 21:04:33.907156 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:33.909352 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5839813-108a-4a26-b4c0-c6cb514f2cb1 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:33.912012 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5839813-108a-4a26-b4c0-c6cb514f2cb1 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.040538 Sep 17 21:04:33.913897 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 15/27] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Sep 17 21:04:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:04:33.928194 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09041e61-db0d-43b9-86eb-4a193fbb8a9f tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Calling method '.version_select at 0x7f9ba7995c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:34.019484 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-09041e61-db0d-43b9-86eb-4a193fbb8a9f tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] HTTP exception thrown: Volume tempest-invalid-29480229 could not be found. Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09041e61-db0d-43b9-86eb-4a193fbb8a9f tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Request method failure captured: Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-29480229 HTTP/1.1 Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZfDCFbOIAws-GzTIXQoYRx60zDgK6PYEHE_g7Qj7cP7pQ3G9zWWHylZKayaFaBAs0PobCwEmcrDM2VPgZJlmDj7LuHBiy80PeC-9PE64T_M1bjZzAAKEwh5Jw4dxjdy7k6jewI7rvV0tlbg9p3oy7DWkECpS7EpM0fWiaarRsNiaU Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: acb8cf4cfdc242ef81676957e2b81a56 Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:04:34.024386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: acb8cf4cfdc242ef81676957e2b81a56 Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-1022028133-project Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 7b5cc9065d6e45398ceb0b8a77b4f8d3 Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-1022028133-project Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Volume tempest-invalid-29480229 could not be found. Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': 'tempest-invalid-29480229'} Sep 17 21:04:34.026195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-29480229 could not be found. (HTTP 404) (Request-ID: req-9a903941-12db-4785-b786-2621b26a6653) Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:34.026869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 17 21:04:34.034333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-29480229 could not be found. Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:34.036421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-29480229 could not be found. Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-29480229 could not be found. Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09041e61-db0d-43b9-86eb-4a193fbb8a9f tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Returning 404 to user: Volume tempest-invalid-29480229 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09041e61-db0d-43b9-86eb-4a193fbb8a9f tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-29480229" status: 404 len: 97 microversion: 2.1 time: 0.105350 Sep 17 21:04:34.038845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 16/28] 10.222.0.16 () {58 vars in 1212 bytes} [Sat Sep 17 21:04:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-29480229 => generated 97 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:04:34.059132 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7567c4a-a473-444f-b87b-1c1579743f7d tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010127 Sep 17 21:04:34.059868 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 17/29] 10.222.0.16 () {58 vars in 1140 bytes} [Sat Sep 17 21:04:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 17 21:04:34.079425 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-88d04ef7-cb27-410a-bf40-e9d1bce74bb3 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:34.082219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-88d04ef7-cb27-410a-bf40-e9d1bce74bb3 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:34.352919 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-88d04ef7-cb27-410a-bf40-e9d1bce74bb3 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:34.367453 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-88d04ef7-cb27-410a-bf40-e9d1bce74bb3 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1215 microversion: 2.1 time: 0.305935 Sep 17 21:04:34.372663 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 18/30] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:34 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1215 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:34.389439 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3c1ec77a-31b0-45b2-ac89-c2303b080fc8 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014374 Sep 17 21:04:34.393991 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 19/31] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 17 21:04:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 17 21:04:34.438675 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6eeda896-228d-4733-9dfc-eeeddb80cba1 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Calling method '.version_select at 0x7f9ba7995160>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:34.539802 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-6eeda896-228d-4733-9dfc-eeeddb80cba1 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] HTTP exception thrown: Volume e31623fd-0d02-4035-a3c1-47b47fa24229 could not be found. Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6eeda896-228d-4733-9dfc-eeeddb80cba1 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Request method failure captured: Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-volumes/e31623fd-0d02-4035-a3c1-47b47fa24229 HTTP/1.1 Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZfDCFbOIAws-GzTIXQoYRx60zDgK6PYEHE_g7Qj7cP7pQ3G9zWWHylZKayaFaBAs0PobCwEmcrDM2VPgZJlmDj7LuHBiy80PeC-9PE64T_M1bjZzAAKEwh5Jw4dxjdy7k6jewI7rvV0tlbg9p3oy7DWkECpS7EpM0fWiaarRsNiaU Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: acb8cf4cfdc242ef81676957e2b81a56 Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:04:34.546576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: acb8cf4cfdc242ef81676957e2b81a56 Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-1022028133-project Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 7b5cc9065d6e45398ceb0b8a77b4f8d3 Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-1022028133-project Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Volume e31623fd-0d02-4035-a3c1-47b47fa24229 could not be found. Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': 'e31623fd-0d02-4035-a3c1-47b47fa24229'} Sep 17 21:04:34.547700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e31623fd-0d02-4035-a3c1-47b47fa24229 could not be found. (HTTP 404) (Request-ID: req-bede131e-a088-4c99-99ac-7b4d39438c8b) Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:34.548567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 17 21:04:34.549540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e31623fd-0d02-4035-a3c1-47b47fa24229 could not be found. Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 17 21:04:34.550466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e31623fd-0d02-4035-a3c1-47b47fa24229 could not be found. Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e31623fd-0d02-4035-a3c1-47b47fa24229 could not be found. Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6eeda896-228d-4733-9dfc-eeeddb80cba1 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Returning 404 to user: Volume e31623fd-0d02-4035-a3c1-47b47fa24229 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6eeda896-228d-4733-9dfc-eeeddb80cba1 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/e31623fd-0d02-4035-a3c1-47b47fa24229" status: 404 len: 109 microversion: 2.1 time: 0.147871 Sep 17 21:04:34.551373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 20/32] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 17 21:04:34 2022] DELETE /compute/v2.1/os-volumes/e31623fd-0d02-4035-a3c1-47b47fa24229 => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:34.561405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b961b0f7-262b-46b5-a5e5-ad920e9a40a2 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Calling method '.version_select at 0x7f9ba799b430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:34.655594 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b961b0f7-262b-46b5-a5e5-ad920e9a40a2 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] HTTP exception thrown: Volume 3219b5d6-a485-4e99-95e1-da4d27551e13 could not be found. Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b961b0f7-262b-46b5-a5e5-ad920e9a40a2 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Request method failure captured: Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/os-volumes/3219b5d6-a485-4e99-95e1-da4d27551e13 HTTP/1.1 Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZfDCFbOIAws-GzTIXQoYRx60zDgK6PYEHE_g7Qj7cP7pQ3G9zWWHylZKayaFaBAs0PobCwEmcrDM2VPgZJlmDj7LuHBiy80PeC-9PE64T_M1bjZzAAKEwh5Jw4dxjdy7k6jewI7rvV0tlbg9p3oy7DWkECpS7EpM0fWiaarRsNiaU Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: acb8cf4cfdc242ef81676957e2b81a56 Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:04:34.658791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_acb8cf4cfdc242ef81676957e2b81a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: acb8cf4cfdc242ef81676957e2b81a56 Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-1022028133 Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-1022028133-project Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 7b5cc9065d6e45398ceb0b8a77b4f8d3 Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-1022028133-project Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Volume 3219b5d6-a485-4e99-95e1-da4d27551e13 could not be found. Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '3219b5d6-a485-4e99-95e1-da4d27551e13'} Sep 17 21:04:34.660155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3219b5d6-a485-4e99-95e1-da4d27551e13 could not be found. (HTTP 404) (Request-ID: req-a9a989d2-5197-4519-b989-c9d9af8ef4b6) Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:34.660998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:04:34.662093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3219b5d6-a485-4e99-95e1-da4d27551e13 could not be found. Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 17 21:04:34.663163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:34.664290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3219b5d6-a485-4e99-95e1-da4d27551e13 could not be found. Sep 17 21:04:34.664290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.664290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:34.664290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.664290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:34.664290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:34.664290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:34.664290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:34.664290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:34.664290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3219b5d6-a485-4e99-95e1-da4d27551e13 could not be found. Sep 17 21:04:34.664290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:04:34.665785 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b961b0f7-262b-46b5-a5e5-ad920e9a40a2 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] Returning 404 to user: Volume 3219b5d6-a485-4e99-95e1-da4d27551e13 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:34.669317 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b961b0f7-262b-46b5-a5e5-ad920e9a40a2 tempest-VolumesNegativeTest-1022028133 tempest-VolumesNegativeTest-1022028133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3219b5d6-a485-4e99-95e1-da4d27551e13" status: 404 len: 109 microversion: 2.1 time: 0.111207 Sep 17 21:04:34.669317 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 21/33] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:04:34 2022] GET /compute/v2.1/os-volumes/3219b5d6-a485-4e99-95e1-da4d27551e13 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:04:35.400378 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-15c67607-29f1-4da6-9894-fe3870f9ffaa tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:35.401337 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-15c67607-29f1-4da6-9894-fe3870f9ffaa tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:35.416730 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15c67607-29f1-4da6-9894-fe3870f9ffaa tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:35.422091 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15c67607-29f1-4da6-9894-fe3870f9ffaa tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:35.422880 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15c67607-29f1-4da6-9894-fe3870f9ffaa tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:35.424814 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15c67607-29f1-4da6-9894-fe3870f9ffaa tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:35.425497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15c67607-29f1-4da6-9894-fe3870f9ffaa tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:35.426110 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15c67607-29f1-4da6-9894-fe3870f9ffaa tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:35.717842 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:04:35.718387 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:04:35.718744 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:04:35.719261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:04:35.719734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:04:35.741212 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:35.741721 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:35.742164 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:35.746565 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:35.749830 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:35.750738 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:35.808325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Getting quotas for project 1e42842c724f480f9cdd5ea75707b43f. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:35.818265 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Getting quotas for user a3dac44116784a9e963a69e4793bac4b and project 1e42842c724f480f9cdd5ea75707b43f. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:35.846129 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:04:35.852488 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:04:35.898213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-15c67607-29f1-4da6-9894-fe3870f9ffaa tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:35.917610 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-15c67607-29f1-4da6-9894-fe3870f9ffaa tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1219 microversion: 2.1 time: 0.522566 Sep 17 21:04:35.918189 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 22/34] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:35 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1219 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:04:35.974359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27491183-48ed-4aae-81a0-622ba3b2b71d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.827421 Sep 17 21:04:35.978030 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 13/35] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:04:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 2830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:04:35.987334 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9238c797-2370-4c3c-8ef8-a69c9a9944d0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:35.987951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9238c797-2370-4c3c-8ef8-a69c9a9944d0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:36.063846 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9238c797-2370-4c3c-8ef8-a69c9a9944d0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:36.074261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9238c797-2370-4c3c-8ef8-a69c9a9944d0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1221 microversion: 2.1 time: 0.090630 Sep 17 21:04:36.083282 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 23/36] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:35 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:36.944887 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6f487aa3-cbe8-4b8e-96c9-b165a5928a63 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:36.945815 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f487aa3-cbe8-4b8e-96c9-b165a5928a63 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:36.962137 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f487aa3-cbe8-4b8e-96c9-b165a5928a63 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:36.965126 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f487aa3-cbe8-4b8e-96c9-b165a5928a63 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:36.965607 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f487aa3-cbe8-4b8e-96c9-b165a5928a63 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:36.966879 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f487aa3-cbe8-4b8e-96c9-b165a5928a63 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:36.968794 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f487aa3-cbe8-4b8e-96c9-b165a5928a63 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:36.970549 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f487aa3-cbe8-4b8e-96c9-b165a5928a63 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:37.101039 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a49ab44-8f44-479f-86a4-8c269bf5bf49 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:37.101657 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a49ab44-8f44-479f-86a4-8c269bf5bf49 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:37.114149 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a49ab44-8f44-479f-86a4-8c269bf5bf49 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:37.117995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a49ab44-8f44-479f-86a4-8c269bf5bf49 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:37.121180 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a49ab44-8f44-479f-86a4-8c269bf5bf49 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:37.122517 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a49ab44-8f44-479f-86a4-8c269bf5bf49 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:37.127730 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a49ab44-8f44-479f-86a4-8c269bf5bf49 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:37.128359 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a49ab44-8f44-479f-86a4-8c269bf5bf49 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:37.261894 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f487aa3-cbe8-4b8e-96c9-b165a5928a63 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:37.287426 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6f487aa3-cbe8-4b8e-96c9-b165a5928a63 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1219 microversion: 2.1 time: 0.349580 Sep 17 21:04:37.301215 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 14/37] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:36 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1219 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:37.364117 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a49ab44-8f44-479f-86a4-8c269bf5bf49 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:37.374179 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a49ab44-8f44-479f-86a4-8c269bf5bf49 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1225 microversion: 2.1 time: 0.277722 Sep 17 21:04:37.378669 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 24/38] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:37 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1225 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:04:38.255218 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-937020511", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9c2d47c-0edd-4dba-a1db-ebe7dbfe9437"}], "security_groups": [{"name": "tempest-securitygroup--1908597625"}], "key_name": "tempest-keypair-1014573676", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:38.319911 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a8cacf9f-c5a9-4d21-945e-a5aece3e2454 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:38.320921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a8cacf9f-c5a9-4d21-945e-a5aece3e2454 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:38.329493 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8cacf9f-c5a9-4d21-945e-a5aece3e2454 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:38.336715 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8cacf9f-c5a9-4d21-945e-a5aece3e2454 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:38.337417 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8cacf9f-c5a9-4d21-945e-a5aece3e2454 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:38.338964 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8cacf9f-c5a9-4d21-945e-a5aece3e2454 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:38.342745 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8cacf9f-c5a9-4d21-945e-a5aece3e2454 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:38.343457 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8cacf9f-c5a9-4d21-945e-a5aece3e2454 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:38.487567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a8cacf9f-c5a9-4d21-945e-a5aece3e2454 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:38.496312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a8cacf9f-c5a9-4d21-945e-a5aece3e2454 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1219 microversion: 2.1 time: 0.181465 Sep 17 21:04:38.515991 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 25/39] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:38 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1219 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:38.524891 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-84bbb2f9-9f8c-401c-961f-75ae3f8482ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:38.528865 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-84bbb2f9-9f8c-401c-961f-75ae3f8482ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:38.548141 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84bbb2f9-9f8c-401c-961f-75ae3f8482ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:38.549665 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84bbb2f9-9f8c-401c-961f-75ae3f8482ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:38.550125 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84bbb2f9-9f8c-401c-961f-75ae3f8482ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:38.555791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84bbb2f9-9f8c-401c-961f-75ae3f8482ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:38.574136 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84bbb2f9-9f8c-401c-961f-75ae3f8482ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:38.574755 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84bbb2f9-9f8c-401c-961f-75ae3f8482ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:38.679609 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] validate_networks() for [('c9c2d47c-0edd-4dba-a1db-ebe7dbfe9437', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:04:38.755249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-84bbb2f9-9f8c-401c-961f-75ae3f8482ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:38.770173 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-84bbb2f9-9f8c-401c-961f-75ae3f8482ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1225 microversion: 2.1 time: 0.248989 Sep 17 21:04:38.770842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 26/40] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:38 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1225 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:38.807723 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-98327252", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2c320a7-411d-4280-a740-e3d2f3da6961"}], "security_groups": [{"name": "tempest-securitygroup--993048713"}], "key_name": "tempest-keypair-1929499607", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:39.051406 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] validate_networks() for [('b2c320a7-411d-4280-a740-e3d2f3da6961', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:04:39.511378 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:04:39.511809 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:04:39.512188 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:04:39.512589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:04:39.513203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:04:39.527736 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:39.528229 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:39.528660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:39.530880 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:39.535675 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:39.536366 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:39.581563 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Getting quotas for project aae15e7cf5d74f9f90e067bb801c7e95. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:39.599503 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Getting quotas for user 4b5e98fb43a143ea8cfa30990b4fffc2 and project aae15e7cf5d74f9f90e067bb801c7e95. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:39.616335 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:04:39.619021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:04:39.689865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-de6483d8-b978-4ff2-a3ad-8ff48c3399e0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.439259 Sep 17 21:04:39.692028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 15/41] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:04:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:04:39.725939 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-22b0722e-0afa-4ccf-9cfb-e5b933648a3d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:39.728286 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-22b0722e-0afa-4ccf-9cfb-e5b933648a3d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:39.747846 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22b0722e-0afa-4ccf-9cfb-e5b933648a3d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:39.749333 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22b0722e-0afa-4ccf-9cfb-e5b933648a3d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:39.750239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22b0722e-0afa-4ccf-9cfb-e5b933648a3d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:39.775917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22b0722e-0afa-4ccf-9cfb-e5b933648a3d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:39.779639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22b0722e-0afa-4ccf-9cfb-e5b933648a3d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:39.783663 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22b0722e-0afa-4ccf-9cfb-e5b933648a3d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:39.868708 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:04:39.869736 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:04:39.870814 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:04:39.871425 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:04:39.872062 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:04:39.911291 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:39.914122 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:39.916150 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:39.918470 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:39.922977 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:39.923444 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:39.971507 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for project d9689fd1a04647cf91a73680e4b677d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:39.982378 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for user 1e3b1e0f4888400b89c47b3e44443228 and project d9689fd1a04647cf91a73680e4b677d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:40.009491 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:04:40.014914 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:04:40.037270 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-22b0722e-0afa-4ccf-9cfb-e5b933648a3d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:40.053471 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-22b0722e-0afa-4ccf-9cfb-e5b933648a3d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1219 microversion: 2.1 time: 0.352674 Sep 17 21:04:40.054553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 16/42] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:39 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1219 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:40.062713 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e7e6d36-f533-47ab-80bb-00e149b6c58e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:40.069438 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5e7e6d36-f533-47ab-80bb-00e149b6c58e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:40.142638 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f74a550-3c96-42a8-9210-e9ec018530c2 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.335560 Sep 17 21:04:40.146767 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 27/43] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:04:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 21:04:40.168294 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4833c605-4321-4fb0-a45e-2da4ae7fa7cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:40.169205 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4833c605-4321-4fb0-a45e-2da4ae7fa7cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:40.177894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4833c605-4321-4fb0-a45e-2da4ae7fa7cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:40.178753 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4833c605-4321-4fb0-a45e-2da4ae7fa7cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:40.179742 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4833c605-4321-4fb0-a45e-2da4ae7fa7cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:40.180709 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4833c605-4321-4fb0-a45e-2da4ae7fa7cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:40.183949 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4833c605-4321-4fb0-a45e-2da4ae7fa7cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:40.184690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4833c605-4321-4fb0-a45e-2da4ae7fa7cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:40.283343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e7e6d36-f533-47ab-80bb-00e149b6c58e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:40.302501 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5e7e6d36-f533-47ab-80bb-00e149b6c58e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1237 microversion: 2.1 time: 0.235600 Sep 17 21:04:40.304625 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 17/44] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:40 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1237 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:40.323780 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba9390a6-4905-4eb5-b90b-230106cd77c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:40.339906 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba9390a6-4905-4eb5-b90b-230106cd77c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:40.424080 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4833c605-4321-4fb0-a45e-2da4ae7fa7cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:40.435856 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4833c605-4321-4fb0-a45e-2da4ae7fa7cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1217 microversion: 2.1 time: 0.285751 Sep 17 21:04:40.437487 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 28/45] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:40 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1217 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:40.511636 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ba9390a6-4905-4eb5-b90b-230106cd77c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:40.521912 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba9390a6-4905-4eb5-b90b-230106cd77c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1240 microversion: 2.1 time: 0.215354 Sep 17 21:04:40.522610 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 18/46] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:40 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1240 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:41.097422 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4575101a-e7af-414d-aa97-96ca49e15fa1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:41.098908 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4575101a-e7af-414d-aa97-96ca49e15fa1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:41.122942 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4575101a-e7af-414d-aa97-96ca49e15fa1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.127756 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4575101a-e7af-414d-aa97-96ca49e15fa1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.130651 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4575101a-e7af-414d-aa97-96ca49e15fa1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.133557 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4575101a-e7af-414d-aa97-96ca49e15fa1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.136065 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4575101a-e7af-414d-aa97-96ca49e15fa1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.138830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4575101a-e7af-414d-aa97-96ca49e15fa1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.337081 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33b799bb-c5b8-4dab-b8c4-c54c13807098 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:41.338313 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-33b799bb-c5b8-4dab-b8c4-c54c13807098 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:41.357933 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33b799bb-c5b8-4dab-b8c4-c54c13807098 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.364026 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33b799bb-c5b8-4dab-b8c4-c54c13807098 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.365078 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33b799bb-c5b8-4dab-b8c4-c54c13807098 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.368247 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33b799bb-c5b8-4dab-b8c4-c54c13807098 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.376511 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33b799bb-c5b8-4dab-b8c4-c54c13807098 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.377960 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33b799bb-c5b8-4dab-b8c4-c54c13807098 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.388620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4575101a-e7af-414d-aa97-96ca49e15fa1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:41.407419 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4575101a-e7af-414d-aa97-96ca49e15fa1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1267 microversion: 2.1 time: 0.324541 Sep 17 21:04:41.417731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 29/47] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:41 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1267 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:41.462231 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a0783da-fa67-4fd9-8385-231b9fe284ac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:41.464503 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1a0783da-fa67-4fd9-8385-231b9fe284ac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:41.478791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a0783da-fa67-4fd9-8385-231b9fe284ac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.482697 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a0783da-fa67-4fd9-8385-231b9fe284ac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.484858 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a0783da-fa67-4fd9-8385-231b9fe284ac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.488411 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a0783da-fa67-4fd9-8385-231b9fe284ac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.490509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a0783da-fa67-4fd9-8385-231b9fe284ac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.493302 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a0783da-fa67-4fd9-8385-231b9fe284ac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.613361 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-33b799bb-c5b8-4dab-b8c4-c54c13807098 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:41.623144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33b799bb-c5b8-4dab-b8c4-c54c13807098 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1241 microversion: 2.1 time: 0.290566 Sep 17 21:04:41.623731 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 19/48] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:41 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1241 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:41.641643 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5cffe0d6-85ae-43f4-99d8-ea31913d277d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:41.652365 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5cffe0d6-85ae-43f4-99d8-ea31913d277d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:41.680903 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cffe0d6-85ae-43f4-99d8-ea31913d277d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.681938 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cffe0d6-85ae-43f4-99d8-ea31913d277d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.694581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cffe0d6-85ae-43f4-99d8-ea31913d277d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.695353 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cffe0d6-85ae-43f4-99d8-ea31913d277d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.700586 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cffe0d6-85ae-43f4-99d8-ea31913d277d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.702407 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cffe0d6-85ae-43f4-99d8-ea31913d277d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.771271 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a0783da-fa67-4fd9-8385-231b9fe284ac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:41.789367 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a0783da-fa67-4fd9-8385-231b9fe284ac tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1217 microversion: 2.1 time: 0.325892 Sep 17 21:04:41.793847 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 30/49] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:41 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1217 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:04:41.902459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cffe0d6-85ae-43f4-99d8-ea31913d277d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:41.916190 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5cffe0d6-85ae-43f4-99d8-ea31913d277d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1244 microversion: 2.1 time: 0.278025 Sep 17 21:04:41.917336 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 20/50] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:41 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1244 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:42.441357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9282e85-0326-4d70-a904-34fae70f4e87 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:42.441973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d9282e85-0326-4d70-a904-34fae70f4e87 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:42.465322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9282e85-0326-4d70-a904-34fae70f4e87 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:42.465929 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9282e85-0326-4d70-a904-34fae70f4e87 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:42.485830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9282e85-0326-4d70-a904-34fae70f4e87 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:42.494702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9282e85-0326-4d70-a904-34fae70f4e87 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:42.496571 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9282e85-0326-4d70-a904-34fae70f4e87 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:42.499069 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9282e85-0326-4d70-a904-34fae70f4e87 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:42.653861 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-17e2b711-21e9-445d-87a6-37511fd489dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:42.671900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-17e2b711-21e9-445d-87a6-37511fd489dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:42.681598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17e2b711-21e9-445d-87a6-37511fd489dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:42.683629 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17e2b711-21e9-445d-87a6-37511fd489dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:42.684357 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17e2b711-21e9-445d-87a6-37511fd489dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:42.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17e2b711-21e9-445d-87a6-37511fd489dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:42.687334 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17e2b711-21e9-445d-87a6-37511fd489dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:42.688110 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17e2b711-21e9-445d-87a6-37511fd489dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:42.962253 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9282e85-0326-4d70-a904-34fae70f4e87 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:42.971470 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d9282e85-0326-4d70-a904-34fae70f4e87 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1275 microversion: 2.1 time: 0.537405 Sep 17 21:04:42.977149 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 31/51] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:42 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1275 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:42.980708 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-17e2b711-21e9-445d-87a6-37511fd489dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:42.983995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6a125dd5-a73e-49a1-9a8d-18e048c0b576 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:42.984871 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6a125dd5-a73e-49a1-9a8d-18e048c0b576 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:42.991829 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a125dd5-a73e-49a1-9a8d-18e048c0b576 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:42.992596 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a125dd5-a73e-49a1-9a8d-18e048c0b576 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:43.009220 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a125dd5-a73e-49a1-9a8d-18e048c0b576 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:43.011597 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a125dd5-a73e-49a1-9a8d-18e048c0b576 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:43.012288 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a125dd5-a73e-49a1-9a8d-18e048c0b576 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:43.013020 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a125dd5-a73e-49a1-9a8d-18e048c0b576 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:43.015948 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-17e2b711-21e9-445d-87a6-37511fd489dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1233 microversion: 2.1 time: 0.358394 Sep 17 21:04:43.016604 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 21/52] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:42 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1233 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:04:43.039488 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3801a490-24bf-4aec-8214-5f902db37dda tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:43.040124 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3801a490-24bf-4aec-8214-5f902db37dda tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:43.066034 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3801a490-24bf-4aec-8214-5f902db37dda tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:43.077065 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3801a490-24bf-4aec-8214-5f902db37dda tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:43.082708 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3801a490-24bf-4aec-8214-5f902db37dda tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:43.087132 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3801a490-24bf-4aec-8214-5f902db37dda tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:43.092434 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3801a490-24bf-4aec-8214-5f902db37dda tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:43.100407 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3801a490-24bf-4aec-8214-5f902db37dda tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:43.173418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6a125dd5-a73e-49a1-9a8d-18e048c0b576 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:43.182088 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6a125dd5-a73e-49a1-9a8d-18e048c0b576 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1273 microversion: 2.1 time: 0.203052 Sep 17 21:04:43.186307 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 32/53] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:42 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:43.385864 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3801a490-24bf-4aec-8214-5f902db37dda tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:43.410351 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3801a490-24bf-4aec-8214-5f902db37dda tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1236 microversion: 2.1 time: 0.389362 Sep 17 21:04:43.425021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 22/54] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:43 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1236 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:44.002508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-46ce5c58-b278-4fe7-8e1b-809b9a740082 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:44.005147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-46ce5c58-b278-4fe7-8e1b-809b9a740082 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:44.021080 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46ce5c58-b278-4fe7-8e1b-809b9a740082 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:44.026444 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46ce5c58-b278-4fe7-8e1b-809b9a740082 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:44.031500 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46ce5c58-b278-4fe7-8e1b-809b9a740082 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:44.032438 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46ce5c58-b278-4fe7-8e1b-809b9a740082 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:44.034520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46ce5c58-b278-4fe7-8e1b-809b9a740082 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:44.036443 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46ce5c58-b278-4fe7-8e1b-809b9a740082 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:44.041479 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-adb6dff5-e52a-4503-a144-e8e2a467bf28 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:44.042339 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-adb6dff5-e52a-4503-a144-e8e2a467bf28 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:44.061431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-adb6dff5-e52a-4503-a144-e8e2a467bf28 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:44.061932 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-adb6dff5-e52a-4503-a144-e8e2a467bf28 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:44.062376 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-adb6dff5-e52a-4503-a144-e8e2a467bf28 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:44.071648 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-adb6dff5-e52a-4503-a144-e8e2a467bf28 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:44.075640 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-adb6dff5-e52a-4503-a144-e8e2a467bf28 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:44.076545 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-adb6dff5-e52a-4503-a144-e8e2a467bf28 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:44.296758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-adb6dff5-e52a-4503-a144-e8e2a467bf28 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:44.316531 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-adb6dff5-e52a-4503-a144-e8e2a467bf28 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1289 microversion: 2.1 time: 0.280440 Sep 17 21:04:44.318985 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 23/55] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:44 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1289 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:44.344409 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-542e597c-1696-44cd-afae-92777b1c38eb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:44.352462 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-542e597c-1696-44cd-afae-92777b1c38eb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:44.374401 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-542e597c-1696-44cd-afae-92777b1c38eb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:44.383158 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-542e597c-1696-44cd-afae-92777b1c38eb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:44.384157 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-542e597c-1696-44cd-afae-92777b1c38eb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:44.386590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-542e597c-1696-44cd-afae-92777b1c38eb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:44.390012 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-542e597c-1696-44cd-afae-92777b1c38eb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:44.390802 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-542e597c-1696-44cd-afae-92777b1c38eb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:44.891371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-46ce5c58-b278-4fe7-8e1b-809b9a740082 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:44.920083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-46ce5c58-b278-4fe7-8e1b-809b9a740082 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1273 microversion: 2.1 time: 0.921876 Sep 17 21:04:44.932007 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 33/56] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:43 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1273 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:44.946266 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29516385-d7c0-4102-aa67-bbfa7672da52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:44.960997 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29516385-d7c0-4102-aa67-bbfa7672da52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:44.980559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29516385-d7c0-4102-aa67-bbfa7672da52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:44.981388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29516385-d7c0-4102-aa67-bbfa7672da52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:44.981989 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29516385-d7c0-4102-aa67-bbfa7672da52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:44.983477 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29516385-d7c0-4102-aa67-bbfa7672da52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:44.989066 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29516385-d7c0-4102-aa67-bbfa7672da52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:44.989866 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29516385-d7c0-4102-aa67-bbfa7672da52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:45.364646 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-542e597c-1696-44cd-afae-92777b1c38eb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:45.368056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-542e597c-1696-44cd-afae-92777b1c38eb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1279 microversion: 2.1 time: 1.046179 Sep 17 21:04:45.368937 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 24/57] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:44 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1279 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:45.394793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e02ce369-646a-47f2-a23b-6cfe9be2b2ab tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:45.395430 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e02ce369-646a-47f2-a23b-6cfe9be2b2ab tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:45.413120 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e02ce369-646a-47f2-a23b-6cfe9be2b2ab tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:45.421383 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e02ce369-646a-47f2-a23b-6cfe9be2b2ab tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:45.422557 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e02ce369-646a-47f2-a23b-6cfe9be2b2ab tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:45.423007 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e02ce369-646a-47f2-a23b-6cfe9be2b2ab tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:45.423467 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e02ce369-646a-47f2-a23b-6cfe9be2b2ab tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:45.426885 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e02ce369-646a-47f2-a23b-6cfe9be2b2ab tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:45.548308 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-29516385-d7c0-4102-aa67-bbfa7672da52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:45.563851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29516385-d7c0-4102-aa67-bbfa7672da52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1292 microversion: 2.1 time: 0.630229 Sep 17 21:04:45.564498 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 34/58] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:44 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1292 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:45.911907 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e02ce369-646a-47f2-a23b-6cfe9be2b2ab tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:45.936171 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e02ce369-646a-47f2-a23b-6cfe9be2b2ab tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1295 microversion: 2.1 time: 0.554174 Sep 17 21:04:45.937387 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 25/59] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:45 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1295 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:45.958746 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a244f6d-4584-4fe2-8f79-3a97f406b0b4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:45.959371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a244f6d-4584-4fe2-8f79-3a97f406b0b4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:45.981103 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a244f6d-4584-4fe2-8f79-3a97f406b0b4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:45.981719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a244f6d-4584-4fe2-8f79-3a97f406b0b4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:45.982177 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a244f6d-4584-4fe2-8f79-3a97f406b0b4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:45.982928 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a244f6d-4584-4fe2-8f79-3a97f406b0b4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:45.983392 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a244f6d-4584-4fe2-8f79-3a97f406b0b4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:45.983820 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a244f6d-4584-4fe2-8f79-3a97f406b0b4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:46.405884 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-66583d71-3089-453d-8dd4-4a8a6bca9018 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:46.407595 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-66583d71-3089-453d-8dd4-4a8a6bca9018 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:46.421207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66583d71-3089-453d-8dd4-4a8a6bca9018 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:46.422089 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66583d71-3089-453d-8dd4-4a8a6bca9018 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:46.424603 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66583d71-3089-453d-8dd4-4a8a6bca9018 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:46.427714 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66583d71-3089-453d-8dd4-4a8a6bca9018 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:46.434402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66583d71-3089-453d-8dd4-4a8a6bca9018 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:46.435249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9a244f6d-4584-4fe2-8f79-3a97f406b0b4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:46.435429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66583d71-3089-453d-8dd4-4a8a6bca9018 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:46.450706 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9a244f6d-4584-4fe2-8f79-3a97f406b0b4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.496312 Sep 17 21:04:46.470814 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 35/60] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:45 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:46.607431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca880594-51fd-46ca-b16d-590ab0074610 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:46.608530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ca880594-51fd-46ca-b16d-590ab0074610 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:46.627089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca880594-51fd-46ca-b16d-590ab0074610 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:46.627586 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca880594-51fd-46ca-b16d-590ab0074610 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:46.632287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca880594-51fd-46ca-b16d-590ab0074610 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:46.637817 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca880594-51fd-46ca-b16d-590ab0074610 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:46.643764 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca880594-51fd-46ca-b16d-590ab0074610 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:46.644289 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca880594-51fd-46ca-b16d-590ab0074610 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:46.676832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-66583d71-3089-453d-8dd4-4a8a6bca9018 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:46.698371 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-66583d71-3089-453d-8dd4-4a8a6bca9018 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1279 microversion: 2.1 time: 0.283997 Sep 17 21:04:46.699290 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 26/61] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:46 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1279 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:46.857592 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ca880594-51fd-46ca-b16d-590ab0074610 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:46.895672 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ca880594-51fd-46ca-b16d-590ab0074610 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1300 microversion: 2.1 time: 0.274457 Sep 17 21:04:46.895672 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 36/62] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:46 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1300 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:46.969015 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0c1628fc-9a71-404e-b1ad-d40a2c419cb0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:46.969891 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0c1628fc-9a71-404e-b1ad-d40a2c419cb0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:46.982385 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c1628fc-9a71-404e-b1ad-d40a2c419cb0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:46.983614 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c1628fc-9a71-404e-b1ad-d40a2c419cb0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:46.984223 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c1628fc-9a71-404e-b1ad-d40a2c419cb0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:46.984999 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c1628fc-9a71-404e-b1ad-d40a2c419cb0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:46.985877 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c1628fc-9a71-404e-b1ad-d40a2c419cb0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:46.986482 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c1628fc-9a71-404e-b1ad-d40a2c419cb0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:47.112606 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0c1628fc-9a71-404e-b1ad-d40a2c419cb0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:47.120510 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0c1628fc-9a71-404e-b1ad-d40a2c419cb0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1295 microversion: 2.1 time: 0.156267 Sep 17 21:04:47.121124 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 27/63] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:46 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1295 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:47.478748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4055e89-863e-4902-a8e9-906bfa4f6d85 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:47.479818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4055e89-863e-4902-a8e9-906bfa4f6d85 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:47.486987 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4055e89-863e-4902-a8e9-906bfa4f6d85 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:47.487680 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4055e89-863e-4902-a8e9-906bfa4f6d85 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:47.488123 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4055e89-863e-4902-a8e9-906bfa4f6d85 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:47.488892 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4055e89-863e-4902-a8e9-906bfa4f6d85 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:47.489349 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4055e89-863e-4902-a8e9-906bfa4f6d85 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:47.489779 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4055e89-863e-4902-a8e9-906bfa4f6d85 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:47.624392 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4055e89-863e-4902-a8e9-906bfa4f6d85 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:47.632881 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4055e89-863e-4902-a8e9-906bfa4f6d85 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.159001 Sep 17 21:04:47.633435 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 37/64] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:47 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:47.725857 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-663d6b7a-2de6-4b53-b637-e0186f25882d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:47.727020 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-663d6b7a-2de6-4b53-b637-e0186f25882d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:47.733106 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-663d6b7a-2de6-4b53-b637-e0186f25882d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:47.733663 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-663d6b7a-2de6-4b53-b637-e0186f25882d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:47.734275 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-663d6b7a-2de6-4b53-b637-e0186f25882d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:47.734974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-663d6b7a-2de6-4b53-b637-e0186f25882d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:47.735425 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-663d6b7a-2de6-4b53-b637-e0186f25882d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:47.735843 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-663d6b7a-2de6-4b53-b637-e0186f25882d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:47.877984 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-663d6b7a-2de6-4b53-b637-e0186f25882d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:47.887038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-663d6b7a-2de6-4b53-b637-e0186f25882d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.165030 Sep 17 21:04:47.888209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 28/65] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:47 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:47.918729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-36d0b88a-6af9-4070-94a4-00190e5ee9bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:47.919346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-36d0b88a-6af9-4070-94a4-00190e5ee9bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:47.930812 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36d0b88a-6af9-4070-94a4-00190e5ee9bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:47.932102 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36d0b88a-6af9-4070-94a4-00190e5ee9bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:47.932888 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36d0b88a-6af9-4070-94a4-00190e5ee9bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:47.934112 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36d0b88a-6af9-4070-94a4-00190e5ee9bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:47.934579 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36d0b88a-6af9-4070-94a4-00190e5ee9bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:47.935009 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36d0b88a-6af9-4070-94a4-00190e5ee9bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:48.020731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-36d0b88a-6af9-4070-94a4-00190e5ee9bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:48.031245 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-36d0b88a-6af9-4070-94a4-00190e5ee9bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1300 microversion: 2.1 time: 0.116773 Sep 17 21:04:48.040869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 38/66] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:47 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1300 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:04:48.145570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-353b1498-e5ee-40e7-95d6-4809b41fc168 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:48.146180 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-353b1498-e5ee-40e7-95d6-4809b41fc168 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:48.149191 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:48.153875 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-353b1498-e5ee-40e7-95d6-4809b41fc168 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:48.154377 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-353b1498-e5ee-40e7-95d6-4809b41fc168 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:48.154815 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-353b1498-e5ee-40e7-95d6-4809b41fc168 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:48.155715 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-353b1498-e5ee-40e7-95d6-4809b41fc168 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:48.156405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-353b1498-e5ee-40e7-95d6-4809b41fc168 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:48.157026 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-353b1498-e5ee-40e7-95d6-4809b41fc168 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:48.264610 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-353b1498-e5ee-40e7-95d6-4809b41fc168 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:48.274678 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-353b1498-e5ee-40e7-95d6-4809b41fc168 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1295 microversion: 2.1 time: 0.132777 Sep 17 21:04:48.276177 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 29/67] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:48 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1295 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:48.655812 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-165bd618-4947-4ff8-8cb8-1f10141c4680 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:48.657464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-165bd618-4947-4ff8-8cb8-1f10141c4680 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:48.665982 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165bd618-4947-4ff8-8cb8-1f10141c4680 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:48.667194 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165bd618-4947-4ff8-8cb8-1f10141c4680 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:48.667801 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165bd618-4947-4ff8-8cb8-1f10141c4680 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:48.668791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165bd618-4947-4ff8-8cb8-1f10141c4680 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:48.669469 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165bd618-4947-4ff8-8cb8-1f10141c4680 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:48.669993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165bd618-4947-4ff8-8cb8-1f10141c4680 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:48.911766 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1468fdea-e0d9-4c6a-bfdb-119d38f040d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:48.912443 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1468fdea-e0d9-4c6a-bfdb-119d38f040d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:48.920582 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1468fdea-e0d9-4c6a-bfdb-119d38f040d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:48.921106 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1468fdea-e0d9-4c6a-bfdb-119d38f040d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:48.921537 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1468fdea-e0d9-4c6a-bfdb-119d38f040d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:48.922241 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1468fdea-e0d9-4c6a-bfdb-119d38f040d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:48.922689 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1468fdea-e0d9-4c6a-bfdb-119d38f040d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:48.923109 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1468fdea-e0d9-4c6a-bfdb-119d38f040d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:49.016822 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-165bd618-4947-4ff8-8cb8-1f10141c4680 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:49.020243 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:49.026326 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-165bd618-4947-4ff8-8cb8-1f10141c4680 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.374507 Sep 17 21:04:49.040941 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 39/68] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:48 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:49.059452 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aafe21f8-cfe3-47db-ba06-ed062c3ccf99 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:49.060069 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aafe21f8-cfe3-47db-ba06-ed062c3ccf99 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:49.066330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aafe21f8-cfe3-47db-ba06-ed062c3ccf99 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:49.066826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aafe21f8-cfe3-47db-ba06-ed062c3ccf99 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:49.067398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aafe21f8-cfe3-47db-ba06-ed062c3ccf99 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:49.068099 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aafe21f8-cfe3-47db-ba06-ed062c3ccf99 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:49.068552 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aafe21f8-cfe3-47db-ba06-ed062c3ccf99 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:49.069011 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aafe21f8-cfe3-47db-ba06-ed062c3ccf99 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:49.109482 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1468fdea-e0d9-4c6a-bfdb-119d38f040d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:49.119575 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1468fdea-e0d9-4c6a-bfdb-119d38f040d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.211574 Sep 17 21:04:49.120230 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 30/69] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:48 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:49.140706 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-aafe21f8-cfe3-47db-ba06-ed062c3ccf99 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:49.148947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aafe21f8-cfe3-47db-ba06-ed062c3ccf99 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1300 microversion: 2.1 time: 0.093849 Sep 17 21:04:49.149511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 40/70] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:49 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:49.299487 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-01229568-4b5a-4c84-84eb-0cf2694455b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:49.300129 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-01229568-4b5a-4c84-84eb-0cf2694455b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:49.307534 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01229568-4b5a-4c84-84eb-0cf2694455b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:49.308107 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01229568-4b5a-4c84-84eb-0cf2694455b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:49.308975 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01229568-4b5a-4c84-84eb-0cf2694455b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:49.309971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01229568-4b5a-4c84-84eb-0cf2694455b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:49.310734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01229568-4b5a-4c84-84eb-0cf2694455b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:49.311617 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01229568-4b5a-4c84-84eb-0cf2694455b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:49.383177 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-01229568-4b5a-4c84-84eb-0cf2694455b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:49.394490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01229568-4b5a-4c84-84eb-0cf2694455b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1295 microversion: 2.1 time: 0.096936 Sep 17 21:04:49.395309 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 31/71] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:49 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1295 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:04:50.077208 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee074048-a41c-4ec4-868b-c2195ec5c1d2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:50.080264 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee074048-a41c-4ec4-868b-c2195ec5c1d2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:50.082540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:50.086964 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=22 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:50.101589 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee074048-a41c-4ec4-868b-c2195ec5c1d2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:50.102099 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee074048-a41c-4ec4-868b-c2195ec5c1d2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:50.102544 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee074048-a41c-4ec4-868b-c2195ec5c1d2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.109556 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee074048-a41c-4ec4-868b-c2195ec5c1d2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:50.109996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee074048-a41c-4ec4-868b-c2195ec5c1d2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:50.110478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee074048-a41c-4ec4-868b-c2195ec5c1d2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.144656 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d28aedd-174e-4f57-891f-b7428c546b6b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:50.146098 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d28aedd-174e-4f57-891f-b7428c546b6b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:50.157676 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:50.159561 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d28aedd-174e-4f57-891f-b7428c546b6b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:50.160044 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d28aedd-174e-4f57-891f-b7428c546b6b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:50.160483 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d28aedd-174e-4f57-891f-b7428c546b6b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.161256 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d28aedd-174e-4f57-891f-b7428c546b6b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:50.161712 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d28aedd-174e-4f57-891f-b7428c546b6b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:50.162313 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d28aedd-174e-4f57-891f-b7428c546b6b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.194263 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:50.366575 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d28aedd-174e-4f57-891f-b7428c546b6b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:50.366751 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee074048-a41c-4ec4-868b-c2195ec5c1d2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:50.375327 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d28aedd-174e-4f57-891f-b7428c546b6b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.236067 Sep 17 21:04:50.375542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee074048-a41c-4ec4-868b-c2195ec5c1d2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.323045 Sep 17 21:04:50.380097 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 41/72] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:50 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:50.390289 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-acf41e4e-4225-42c1-a27e-8a0763fa523c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:50.390912 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-acf41e4e-4225-42c1-a27e-8a0763fa523c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:50.392768 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 32/73] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:50 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:50.405279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acf41e4e-4225-42c1-a27e-8a0763fa523c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:50.405906 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acf41e4e-4225-42c1-a27e-8a0763fa523c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:50.406411 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acf41e4e-4225-42c1-a27e-8a0763fa523c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.407185 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acf41e4e-4225-42c1-a27e-8a0763fa523c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:50.407633 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acf41e4e-4225-42c1-a27e-8a0763fa523c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:50.408083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acf41e4e-4225-42c1-a27e-8a0763fa523c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.417774 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e1e81b36-e9fc-40f6-bdba-f64ca727c56f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:50.418489 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e1e81b36-e9fc-40f6-bdba-f64ca727c56f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:50.424695 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1e81b36-e9fc-40f6-bdba-f64ca727c56f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:50.425986 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1e81b36-e9fc-40f6-bdba-f64ca727c56f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:50.425986 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1e81b36-e9fc-40f6-bdba-f64ca727c56f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.426596 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1e81b36-e9fc-40f6-bdba-f64ca727c56f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:50.427144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1e81b36-e9fc-40f6-bdba-f64ca727c56f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:50.427670 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1e81b36-e9fc-40f6-bdba-f64ca727c56f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.478374 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-acf41e4e-4225-42c1-a27e-8a0763fa523c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:50.491823 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-acf41e4e-4225-42c1-a27e-8a0763fa523c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1300 microversion: 2.1 time: 0.110349 Sep 17 21:04:50.492387 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 42/74] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:50 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:50.516523 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e1e81b36-e9fc-40f6-bdba-f64ca727c56f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:50.525247 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=28 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:50.527265 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e1e81b36-e9fc-40f6-bdba-f64ca727c56f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1295 microversion: 2.1 time: 0.113861 Sep 17 21:04:50.527916 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 33/75] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:50 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1295 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:51.407728 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a61d9816-824a-46bd-8583-2c2a08dabd80 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:51.409772 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a61d9816-824a-46bd-8583-2c2a08dabd80 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:51.417094 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f90f8267-cc21-42fa-bff7-81395298140e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:51.417870 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f90f8267-cc21-42fa-bff7-81395298140e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:51.419845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:51.422239 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a61d9816-824a-46bd-8583-2c2a08dabd80 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:51.422778 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a61d9816-824a-46bd-8583-2c2a08dabd80 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:51.423404 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a61d9816-824a-46bd-8583-2c2a08dabd80 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:51.425087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a61d9816-824a-46bd-8583-2c2a08dabd80 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:51.427810 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a61d9816-824a-46bd-8583-2c2a08dabd80 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:51.427810 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a61d9816-824a-46bd-8583-2c2a08dabd80 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:51.434190 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f90f8267-cc21-42fa-bff7-81395298140e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:51.435228 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f90f8267-cc21-42fa-bff7-81395298140e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:51.436522 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f90f8267-cc21-42fa-bff7-81395298140e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:51.440160 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f90f8267-cc21-42fa-bff7-81395298140e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:51.441362 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f90f8267-cc21-42fa-bff7-81395298140e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:51.444340 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f90f8267-cc21-42fa-bff7-81395298140e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:51.718053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a61d9816-824a-46bd-8583-2c2a08dabd80 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:51.730424 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a61d9816-824a-46bd-8583-2c2a08dabd80 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.332329 Sep 17 21:04:51.730962 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 43/76] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:51 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:51.737809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b99c82f5-2027-4992-8a4a-ab9999ae8c9b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:51.738423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b99c82f5-2027-4992-8a4a-ab9999ae8c9b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:51.748143 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f90f8267-cc21-42fa-bff7-81395298140e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:51.760437 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f90f8267-cc21-42fa-bff7-81395298140e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.350013 Sep 17 21:04:51.762023 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 34/77] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:51 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:51.764901 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b99c82f5-2027-4992-8a4a-ab9999ae8c9b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:51.764901 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b99c82f5-2027-4992-8a4a-ab9999ae8c9b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:51.764901 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b99c82f5-2027-4992-8a4a-ab9999ae8c9b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:51.767806 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b99c82f5-2027-4992-8a4a-ab9999ae8c9b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:51.768419 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b99c82f5-2027-4992-8a4a-ab9999ae8c9b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:51.769678 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b99c82f5-2027-4992-8a4a-ab9999ae8c9b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:51.781187 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5a2eb53d-1707-4470-81b4-dad38c710813 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:51.785462 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5a2eb53d-1707-4470-81b4-dad38c710813 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:51.802127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a2eb53d-1707-4470-81b4-dad38c710813 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:51.810508 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a2eb53d-1707-4470-81b4-dad38c710813 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:51.811812 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a2eb53d-1707-4470-81b4-dad38c710813 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:51.812789 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a2eb53d-1707-4470-81b4-dad38c710813 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:51.813877 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a2eb53d-1707-4470-81b4-dad38c710813 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:51.815637 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a2eb53d-1707-4470-81b4-dad38c710813 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:51.945728 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b99c82f5-2027-4992-8a4a-ab9999ae8c9b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:51.966130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b99c82f5-2027-4992-8a4a-ab9999ae8c9b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1300 microversion: 2.1 time: 0.234081 Sep 17 21:04:51.966822 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 44/78] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:51 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1300 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:51.988982 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5a2eb53d-1707-4470-81b4-dad38c710813 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:51.998749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5a2eb53d-1707-4470-81b4-dad38c710813 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1295 microversion: 2.1 time: 0.235030 Sep 17 21:04:51.999339 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 35/79] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:51 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1295 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:52.756749 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f884877-ffea-4215-8b87-371e83bd147f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:52.758736 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f884877-ffea-4215-8b87-371e83bd147f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:52.782112 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f884877-ffea-4215-8b87-371e83bd147f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:52.789030 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2fcc1558-849a-4b6b-9ad3-31e11394c26b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:52.791102 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2fcc1558-849a-4b6b-9ad3-31e11394c26b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:52.797942 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcc1558-849a-4b6b-9ad3-31e11394c26b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:52.798413 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcc1558-849a-4b6b-9ad3-31e11394c26b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:52.798878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcc1558-849a-4b6b-9ad3-31e11394c26b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:52.799707 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcc1558-849a-4b6b-9ad3-31e11394c26b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:52.800160 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcc1558-849a-4b6b-9ad3-31e11394c26b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:52.800663 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcc1558-849a-4b6b-9ad3-31e11394c26b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:52.804115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f884877-ffea-4215-8b87-371e83bd147f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:52.805172 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f884877-ffea-4215-8b87-371e83bd147f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:52.806642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f884877-ffea-4215-8b87-371e83bd147f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:52.807302 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f884877-ffea-4215-8b87-371e83bd147f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:52.807880 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f884877-ffea-4215-8b87-371e83bd147f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:53.361529 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2fcc1558-849a-4b6b-9ad3-31e11394c26b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:53.386013 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f884877-ffea-4215-8b87-371e83bd147f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:53.390371 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2fcc1558-849a-4b6b-9ad3-31e11394c26b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.596556 Sep 17 21:04:53.393673 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 36/80] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:52 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:53.398299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f884877-ffea-4215-8b87-371e83bd147f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.648023 Sep 17 21:04:53.422208 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 45/81] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:52 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:53.427299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f97fe1f5-89ec-4203-b60e-6f2462252cce tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:53.427895 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f97fe1f5-89ec-4203-b60e-6f2462252cce tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:53.431829 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1b8fbb73-c53a-434d-ba05-10105055ba66 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:53.432623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1b8fbb73-c53a-434d-ba05-10105055ba66 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:53.441906 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b8fbb73-c53a-434d-ba05-10105055ba66 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:53.443618 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f97fe1f5-89ec-4203-b60e-6f2462252cce tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:53.444245 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b8fbb73-c53a-434d-ba05-10105055ba66 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:53.444869 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b8fbb73-c53a-434d-ba05-10105055ba66 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:53.445741 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b8fbb73-c53a-434d-ba05-10105055ba66 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:53.447225 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f97fe1f5-89ec-4203-b60e-6f2462252cce tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:53.447905 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f97fe1f5-89ec-4203-b60e-6f2462252cce tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:53.448614 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f97fe1f5-89ec-4203-b60e-6f2462252cce tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:53.449436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b8fbb73-c53a-434d-ba05-10105055ba66 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:53.449891 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b8fbb73-c53a-434d-ba05-10105055ba66 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:53.452902 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f97fe1f5-89ec-4203-b60e-6f2462252cce tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:53.453370 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f97fe1f5-89ec-4203-b60e-6f2462252cce tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:53.589702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f97fe1f5-89ec-4203-b60e-6f2462252cce tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:53.599048 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b8fbb73-c53a-434d-ba05-10105055ba66 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:53.607928 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f97fe1f5-89ec-4203-b60e-6f2462252cce tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1295 microversion: 2.1 time: 0.184273 Sep 17 21:04:53.613101 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1b8fbb73-c53a-434d-ba05-10105055ba66 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1300 microversion: 2.1 time: 0.216743 Sep 17 21:04:53.614925 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 37/82] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:53 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1300 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:53.629259 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 46/83] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:53 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1295 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:54.419386 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6f16e73-e8b9-403c-8a99-2a92ac39a0cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:54.420000 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c6f16e73-e8b9-403c-8a99-2a92ac39a0cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:54.429166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4951b667-9037-4644-ae02-e30104a9571d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:54.434423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4951b667-9037-4644-ae02-e30104a9571d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:54.441758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f16e73-e8b9-403c-8a99-2a92ac39a0cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:54.443578 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f16e73-e8b9-403c-8a99-2a92ac39a0cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:54.445797 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f16e73-e8b9-403c-8a99-2a92ac39a0cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:54.449795 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f16e73-e8b9-403c-8a99-2a92ac39a0cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:54.451531 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f16e73-e8b9-403c-8a99-2a92ac39a0cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:54.453917 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4951b667-9037-4644-ae02-e30104a9571d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:54.454257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f16e73-e8b9-403c-8a99-2a92ac39a0cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:54.454501 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4951b667-9037-4644-ae02-e30104a9571d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:54.456102 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4951b667-9037-4644-ae02-e30104a9571d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:54.459006 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4951b667-9037-4644-ae02-e30104a9571d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:54.459681 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4951b667-9037-4644-ae02-e30104a9571d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:54.460332 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4951b667-9037-4644-ae02-e30104a9571d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:55.014906 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c6f16e73-e8b9-403c-8a99-2a92ac39a0cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:55.039834 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c6f16e73-e8b9-403c-8a99-2a92ac39a0cd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.625901 Sep 17 21:04:55.043668 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 38/84] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:54 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:55.059896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b219d409-0f24-4479-82c8-74692e5a14e5 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:55.073183 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b219d409-0f24-4479-82c8-74692e5a14e5 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:55.100372 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b219d409-0f24-4479-82c8-74692e5a14e5 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:55.111294 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b219d409-0f24-4479-82c8-74692e5a14e5 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:55.111816 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b219d409-0f24-4479-82c8-74692e5a14e5 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:55.112806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b219d409-0f24-4479-82c8-74692e5a14e5 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:55.115020 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b219d409-0f24-4479-82c8-74692e5a14e5 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:55.115683 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b219d409-0f24-4479-82c8-74692e5a14e5 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:55.209667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4951b667-9037-4644-ae02-e30104a9571d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:55.219994 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4951b667-9037-4644-ae02-e30104a9571d tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.792908 Sep 17 21:04:55.220901 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 47/85] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:54 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:55.244463 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f4343643-8c1c-4b06-ad25-2bd0564c6e0a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:55.245336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f4343643-8c1c-4b06-ad25-2bd0564c6e0a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:55.252747 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4343643-8c1c-4b06-ad25-2bd0564c6e0a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:55.254160 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4343643-8c1c-4b06-ad25-2bd0564c6e0a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:55.254826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4343643-8c1c-4b06-ad25-2bd0564c6e0a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:55.255762 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4343643-8c1c-4b06-ad25-2bd0564c6e0a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:55.256371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4343643-8c1c-4b06-ad25-2bd0564c6e0a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:55.257037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4343643-8c1c-4b06-ad25-2bd0564c6e0a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:55.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b219d409-0f24-4479-82c8-74692e5a14e5 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:55.376204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b219d409-0f24-4479-82c8-74692e5a14e5 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1300 microversion: 2.1 time: 0.330246 Sep 17 21:04:55.376760 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 39/86] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:55 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1300 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:55.388038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f4343643-8c1c-4b06-ad25-2bd0564c6e0a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:55.399148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f4343643-8c1c-4b06-ad25-2bd0564c6e0a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1295 microversion: 2.1 time: 0.159126 Sep 17 21:04:55.407582 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 48/87] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:55 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1295 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:56.068336 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f89c9702-8098-4cc2-99a3-d717b0e3e254 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:56.069777 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f89c9702-8098-4cc2-99a3-d717b0e3e254 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:56.084788 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f89c9702-8098-4cc2-99a3-d717b0e3e254 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:56.085300 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f89c9702-8098-4cc2-99a3-d717b0e3e254 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:56.085749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f89c9702-8098-4cc2-99a3-d717b0e3e254 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:56.086472 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f89c9702-8098-4cc2-99a3-d717b0e3e254 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:56.087552 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f89c9702-8098-4cc2-99a3-d717b0e3e254 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:56.088255 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f89c9702-8098-4cc2-99a3-d717b0e3e254 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:56.248481 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f9c5d97a-f295-4be4-9952-875fa031bdb1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:56.249210 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f9c5d97a-f295-4be4-9952-875fa031bdb1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:56.266500 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9c5d97a-f295-4be4-9952-875fa031bdb1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:56.267009 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9c5d97a-f295-4be4-9952-875fa031bdb1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:56.267456 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9c5d97a-f295-4be4-9952-875fa031bdb1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:56.272336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9c5d97a-f295-4be4-9952-875fa031bdb1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:56.273043 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9c5d97a-f295-4be4-9952-875fa031bdb1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:56.274206 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9c5d97a-f295-4be4-9952-875fa031bdb1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:57.045319 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f89c9702-8098-4cc2-99a3-d717b0e3e254 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:57.057624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f89c9702-8098-4cc2-99a3-d717b0e3e254 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.988906 Sep 17 21:04:57.058925 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 40/88] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:56 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:57.066405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c323bb09-3ccb-4f7b-bc37-12b536b93023 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:57.070462 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c323bb09-3ccb-4f7b-bc37-12b536b93023 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:57.085541 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c323bb09-3ccb-4f7b-bc37-12b536b93023 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:57.088275 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c323bb09-3ccb-4f7b-bc37-12b536b93023 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:57.089334 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c323bb09-3ccb-4f7b-bc37-12b536b93023 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:57.092109 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c323bb09-3ccb-4f7b-bc37-12b536b93023 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:57.095280 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c323bb09-3ccb-4f7b-bc37-12b536b93023 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:57.095927 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c323bb09-3ccb-4f7b-bc37-12b536b93023 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:57.119969 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f9c5d97a-f295-4be4-9952-875fa031bdb1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:57.133401 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f9c5d97a-f295-4be4-9952-875fa031bdb1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.889621 Sep 17 21:04:57.140473 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 49/89] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:56 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:57.154806 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ffa30818-6505-4173-b276-b2ebbc189306 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:57.160152 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ffa30818-6505-4173-b276-b2ebbc189306 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:57.179243 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffa30818-6505-4173-b276-b2ebbc189306 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:57.179751 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffa30818-6505-4173-b276-b2ebbc189306 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:57.180184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffa30818-6505-4173-b276-b2ebbc189306 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:57.189061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffa30818-6505-4173-b276-b2ebbc189306 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:57.192019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffa30818-6505-4173-b276-b2ebbc189306 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:57.192750 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffa30818-6505-4173-b276-b2ebbc189306 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:57.367439 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c323bb09-3ccb-4f7b-bc37-12b536b93023 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:57.379060 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ffa30818-6505-4173-b276-b2ebbc189306 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:57.395938 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c323bb09-3ccb-4f7b-bc37-12b536b93023 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1298 microversion: 2.1 time: 0.332717 Sep 17 21:04:57.396634 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 41/90] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:57 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1298 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:57.396855 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ffa30818-6505-4173-b276-b2ebbc189306 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1295 microversion: 2.1 time: 0.252649 Sep 17 21:04:57.397730 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 50/91] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:57 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1295 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:58.085359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32258bb6-08d5-4db9-ba91-e7c0ae33c18c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:58.086045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32258bb6-08d5-4db9-ba91-e7c0ae33c18c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:58.098497 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32258bb6-08d5-4db9-ba91-e7c0ae33c18c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:58.102029 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32258bb6-08d5-4db9-ba91-e7c0ae33c18c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:58.103697 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32258bb6-08d5-4db9-ba91-e7c0ae33c18c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:58.106418 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32258bb6-08d5-4db9-ba91-e7c0ae33c18c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:58.108266 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32258bb6-08d5-4db9-ba91-e7c0ae33c18c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:58.110711 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32258bb6-08d5-4db9-ba91-e7c0ae33c18c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:58.167130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49740c34-fca2-40f4-a863-bc72626abe7e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:58.168320 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49740c34-fca2-40f4-a863-bc72626abe7e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:58.185806 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49740c34-fca2-40f4-a863-bc72626abe7e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:58.186623 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49740c34-fca2-40f4-a863-bc72626abe7e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:58.186847 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49740c34-fca2-40f4-a863-bc72626abe7e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:58.187591 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49740c34-fca2-40f4-a863-bc72626abe7e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:58.188224 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49740c34-fca2-40f4-a863-bc72626abe7e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:58.208112 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49740c34-fca2-40f4-a863-bc72626abe7e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:59.029928 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-32258bb6-08d5-4db9-ba91-e7c0ae33c18c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:59.042968 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32258bb6-08d5-4db9-ba91-e7c0ae33c18c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.961582 Sep 17 21:04:59.044306 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 42/92] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:58 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:59.052466 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f24a1d8d-446e-4df7-bec6-9e188f1a03a6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:59.053949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f24a1d8d-446e-4df7-bec6-9e188f1a03a6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:59.065717 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f24a1d8d-446e-4df7-bec6-9e188f1a03a6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:59.067111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f24a1d8d-446e-4df7-bec6-9e188f1a03a6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:59.067765 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f24a1d8d-446e-4df7-bec6-9e188f1a03a6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:59.069018 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f24a1d8d-446e-4df7-bec6-9e188f1a03a6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:59.070034 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f24a1d8d-446e-4df7-bec6-9e188f1a03a6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:59.071450 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f24a1d8d-446e-4df7-bec6-9e188f1a03a6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:59.127925 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-49740c34-fca2-40f4-a863-bc72626abe7e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:59.151675 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49740c34-fca2-40f4-a863-bc72626abe7e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.980451 Sep 17 21:04:59.155060 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 51/93] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:58 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:59.162550 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05b8dac2-cb12-4fa2-b24a-13950a0d45f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:59.163129 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-05b8dac2-cb12-4fa2-b24a-13950a0d45f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:59.192533 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05b8dac2-cb12-4fa2-b24a-13950a0d45f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:59.195088 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05b8dac2-cb12-4fa2-b24a-13950a0d45f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:59.198495 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05b8dac2-cb12-4fa2-b24a-13950a0d45f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:59.200665 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05b8dac2-cb12-4fa2-b24a-13950a0d45f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:59.202456 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05b8dac2-cb12-4fa2-b24a-13950a0d45f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:59.203521 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05b8dac2-cb12-4fa2-b24a-13950a0d45f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:59.697853 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f24a1d8d-446e-4df7-bec6-9e188f1a03a6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:59.707907 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f24a1d8d-446e-4df7-bec6-9e188f1a03a6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.661767 Sep 17 21:04:59.710986 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 43/94] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:59 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:59.770283 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-05b8dac2-cb12-4fa2-b24a-13950a0d45f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:59.778659 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-05b8dac2-cb12-4fa2-b24a-13950a0d45f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.619796 Sep 17 21:04:59.791543 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 52/95] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:59 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:00.068779 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-35329e14-4020-4f2c-8465-c77c57663ff9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:00.069623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-35329e14-4020-4f2c-8465-c77c57663ff9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:00.077239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35329e14-4020-4f2c-8465-c77c57663ff9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.080826 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35329e14-4020-4f2c-8465-c77c57663ff9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.094601 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35329e14-4020-4f2c-8465-c77c57663ff9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.096548 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35329e14-4020-4f2c-8465-c77c57663ff9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.098249 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35329e14-4020-4f2c-8465-c77c57663ff9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.104858 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35329e14-4020-4f2c-8465-c77c57663ff9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.182709 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd498b55-278f-4f2b-b4b3-21ff8e722e13 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:00.183545 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd498b55-278f-4f2b-b4b3-21ff8e722e13 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:00.200102 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd498b55-278f-4f2b-b4b3-21ff8e722e13 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.201470 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd498b55-278f-4f2b-b4b3-21ff8e722e13 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.202320 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd498b55-278f-4f2b-b4b3-21ff8e722e13 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.203050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd498b55-278f-4f2b-b4b3-21ff8e722e13 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.203514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd498b55-278f-4f2b-b4b3-21ff8e722e13 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.205940 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd498b55-278f-4f2b-b4b3-21ff8e722e13 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.060592 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-35329e14-4020-4f2c-8465-c77c57663ff9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:01.074420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-35329e14-4020-4f2c-8465-c77c57663ff9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 1.009062 Sep 17 21:05:01.075578 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 44/96] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:00 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:01.241938 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd498b55-278f-4f2b-b4b3-21ff8e722e13 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:01.253360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd498b55-278f-4f2b-b4b3-21ff8e722e13 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 1.077220 Sep 17 21:05:01.268593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 53/97] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:00 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:01.276636 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5881078f-8a9a-46b2-9947-2025733a72a1 req-832488d6-516d-4a0d-99e3-dc689876dd20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d0d277-2981-45b9-88e1-1d9dd5aaaff5", "tag": "060a7e1b-7fa9-476f-b5fa-fbf114cbea0a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:01.297904 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5881078f-8a9a-46b2-9947-2025733a72a1 req-832488d6-516d-4a0d-99e3-dc689876dd20 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.298241 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5881078f-8a9a-46b2-9947-2025733a72a1 req-832488d6-516d-4a0d-99e3-dc689876dd20 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.298822 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5881078f-8a9a-46b2-9947-2025733a72a1 req-832488d6-516d-4a0d-99e3-dc689876dd20 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.322592 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5881078f-8a9a-46b2-9947-2025733a72a1 req-832488d6-516d-4a0d-99e3-dc689876dd20 service nova] Creating event network-changed:060a7e1b-7fa9-476f-b5fa-fbf114cbea0a for instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 on hv-cinder-82651 Sep 17 21:05:01.322885 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5881078f-8a9a-46b2-9947-2025733a72a1 req-832488d6-516d-4a0d-99e3-dc689876dd20 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 21:05:01.323276 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5881078f-8a9a-46b2-9947-2025733a72a1 req-832488d6-516d-4a0d-99e3-dc689876dd20 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 21:05:01.324311 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02ebc0-8921-4eae-bb81-0ae669b46d08 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.324807 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02ebc0-8921-4eae-bb81-0ae669b46d08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.325238 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02ebc0-8921-4eae-bb81-0ae669b46d08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.326702 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02ebc0-8921-4eae-bb81-0ae669b46d08 None None] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.327158 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02ebc0-8921-4eae-bb81-0ae669b46d08 None None] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.327577 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02ebc0-8921-4eae-bb81-0ae669b46d08 None None] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.338421 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.compute.rpcapi [None req-ac02ebc0-8921-4eae-bb81-0ae669b46d08 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 17 21:05:01.339481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02ebc0-8921-4eae-bb81-0ae669b46d08 None None] Releasing lock "compute-rpcapi-router" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 21:05:01.363892 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ac02ebc0-8921-4eae-bb81-0ae669b46d08 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286683 Sep 17 21:05:01.364658 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 45/98] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:01.375295 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fa6f7511-1fc5-460d-8a37-53ec97a663fa tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:01.376008 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fa6f7511-1fc5-460d-8a37-53ec97a663fa tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:01.382548 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa6f7511-1fc5-460d-8a37-53ec97a663fa tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.384758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa6f7511-1fc5-460d-8a37-53ec97a663fa tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.385426 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa6f7511-1fc5-460d-8a37-53ec97a663fa tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.386159 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa6f7511-1fc5-460d-8a37-53ec97a663fa tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.390447 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-aedb3449-91d2-49ab-b4e0-70530cd4b099 req-ad3bd0eb-e7cf-49e5-a3c6-d466817e1b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06bc19de-a634-49b9-b594-e66f5a07f584", "tag": "a8a5bbd2-ce5f-46bf-b7f6-75feb45e9e31"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:01.395002 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa6f7511-1fc5-460d-8a37-53ec97a663fa tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.395564 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa6f7511-1fc5-460d-8a37-53ec97a663fa tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.407479 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aedb3449-91d2-49ab-b4e0-70530cd4b099 req-ad3bd0eb-e7cf-49e5-a3c6-d466817e1b43 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.408322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aedb3449-91d2-49ab-b4e0-70530cd4b099 req-ad3bd0eb-e7cf-49e5-a3c6-d466817e1b43 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.409245 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aedb3449-91d2-49ab-b4e0-70530cd4b099 req-ad3bd0eb-e7cf-49e5-a3c6-d466817e1b43 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.432215 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-aedb3449-91d2-49ab-b4e0-70530cd4b099 req-ad3bd0eb-e7cf-49e5-a3c6-d466817e1b43 service nova] Creating event network-changed:a8a5bbd2-ce5f-46bf-b7f6-75feb45e9e31 for instance 06bc19de-a634-49b9-b594-e66f5a07f584 on hv-cinder-82651 Sep 17 21:05:01.433123 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aedb3449-91d2-49ab-b4e0-70530cd4b099 req-ad3bd0eb-e7cf-49e5-a3c6-d466817e1b43 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 21:05:01.433835 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aedb3449-91d2-49ab-b4e0-70530cd4b099 req-ad3bd0eb-e7cf-49e5-a3c6-d466817e1b43 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 21:05:01.435214 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62e9c5c9-15e8-4a40-8141-01010534caef None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.435894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62e9c5c9-15e8-4a40-8141-01010534caef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.436541 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62e9c5c9-15e8-4a40-8141-01010534caef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.437509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62e9c5c9-15e8-4a40-8141-01010534caef None None] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.438213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62e9c5c9-15e8-4a40-8141-01010534caef None None] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.438848 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62e9c5c9-15e8-4a40-8141-01010534caef None None] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.449220 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.compute.rpcapi [None req-62e9c5c9-15e8-4a40-8141-01010534caef None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 17 21:05:01.450470 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62e9c5c9-15e8-4a40-8141-01010534caef None None] Releasing lock "compute-rpcapi-router" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 21:05:01.468740 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-62e9c5c9-15e8-4a40-8141-01010534caef None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186656 Sep 17 21:05:01.469502 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 54/99] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:01.475002 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-692db098-23d8-4985-8fa0-bf93afe6d569 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:01.475726 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-692db098-23d8-4985-8fa0-bf93afe6d569 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:01.484375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-692db098-23d8-4985-8fa0-bf93afe6d569 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.484887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-692db098-23d8-4985-8fa0-bf93afe6d569 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.485722 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-692db098-23d8-4985-8fa0-bf93afe6d569 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.486019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-692db098-23d8-4985-8fa0-bf93afe6d569 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.486465 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-692db098-23d8-4985-8fa0-bf93afe6d569 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.486883 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-692db098-23d8-4985-8fa0-bf93afe6d569 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:02.061958 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-692db098-23d8-4985-8fa0-bf93afe6d569 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:02.066691 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fa6f7511-1fc5-460d-8a37-53ec97a663fa tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:02.072065 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-692db098-23d8-4985-8fa0-bf93afe6d569 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.601069 Sep 17 21:05:02.073036 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 55/100] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:01 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:02.094925 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fa6f7511-1fc5-460d-8a37-53ec97a663fa tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.729107 Sep 17 21:05:02.096398 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 46/101] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:01 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:02.106370 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27e3821e-c0a2-4eda-adb4-60a696c95f8e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:02.106648 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-27e3821e-c0a2-4eda-adb4-60a696c95f8e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:02.115340 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e3821e-c0a2-4eda-adb4-60a696c95f8e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:02.115819 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e3821e-c0a2-4eda-adb4-60a696c95f8e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:02.116255 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e3821e-c0a2-4eda-adb4-60a696c95f8e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:02.117040 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e3821e-c0a2-4eda-adb4-60a696c95f8e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:02.117497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e3821e-c0a2-4eda-adb4-60a696c95f8e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:02.117990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e3821e-c0a2-4eda-adb4-60a696c95f8e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:02.280807 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c13169e2-abcb-4b87-8940-ee397d3baaae tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:02.281477 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c13169e2-abcb-4b87-8940-ee397d3baaae tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:02.291247 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c13169e2-abcb-4b87-8940-ee397d3baaae tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:02.292060 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c13169e2-abcb-4b87-8940-ee397d3baaae tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:02.292502 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c13169e2-abcb-4b87-8940-ee397d3baaae tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:02.294191 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c13169e2-abcb-4b87-8940-ee397d3baaae tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:02.294944 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c13169e2-abcb-4b87-8940-ee397d3baaae tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:02.295608 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c13169e2-abcb-4b87-8940-ee397d3baaae tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:02.413925 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-27e3821e-c0a2-4eda-adb4-60a696c95f8e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:02.419025 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:02.429522 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-27e3821e-c0a2-4eda-adb4-60a696c95f8e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.328478 Sep 17 21:05:02.432535 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 56/102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:02 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:02.545332 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c13169e2-abcb-4b87-8940-ee397d3baaae tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:02.554897 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c13169e2-abcb-4b87-8940-ee397d3baaae tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.279600 Sep 17 21:05:02.556026 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 47/103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:02 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:03.095644 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c5a28fa-21e7-4cea-89e2-b1409428650c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:03.096549 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5c5a28fa-21e7-4cea-89e2-b1409428650c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:03.103914 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5a28fa-21e7-4cea-89e2-b1409428650c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.104710 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5a28fa-21e7-4cea-89e2-b1409428650c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.105396 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5a28fa-21e7-4cea-89e2-b1409428650c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.106099 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5a28fa-21e7-4cea-89e2-b1409428650c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.106558 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5a28fa-21e7-4cea-89e2-b1409428650c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.107158 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5a28fa-21e7-4cea-89e2-b1409428650c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.127721 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5d39647b-8e8a-4f3f-9ece-74176492885d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:03.130660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5d39647b-8e8a-4f3f-9ece-74176492885d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:03.141466 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d39647b-8e8a-4f3f-9ece-74176492885d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.143556 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d39647b-8e8a-4f3f-9ece-74176492885d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.146700 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d39647b-8e8a-4f3f-9ece-74176492885d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.147474 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d39647b-8e8a-4f3f-9ece-74176492885d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.147912 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d39647b-8e8a-4f3f-9ece-74176492885d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.148470 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d39647b-8e8a-4f3f-9ece-74176492885d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.361091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5d39647b-8e8a-4f3f-9ece-74176492885d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:03.364403 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5c5a28fa-21e7-4cea-89e2-b1409428650c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:03.373388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5c5a28fa-21e7-4cea-89e2-b1409428650c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.282860 Sep 17 21:05:03.373965 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 57/104] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:03 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:03.378601 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5d39647b-8e8a-4f3f-9ece-74176492885d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.257360 Sep 17 21:05:03.379339 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 48/105] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:03 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:03.384915 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3f200f02-d427-4fc0-95b4-bbe6acf05eff req-7f158968-4341-4fd6-b578-b60017113b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19898312-d61b-457d-8217-d6c8e2ad2dbc", "tag": "b2f701f8-a237-4a6e-9896-f63fd717b63e"}, {"name": "network-changed", "server_uuid": "b38b7550-7fb1-4104-b38d-6ae86dbe3a1e", "tag": "9475a995-1a52-4771-b571-1e84b3dbc2f6"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:03.396328 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3f200f02-d427-4fc0-95b4-bbe6acf05eff req-7f158968-4341-4fd6-b578-b60017113b9a service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.397120 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3f200f02-d427-4fc0-95b4-bbe6acf05eff req-7f158968-4341-4fd6-b578-b60017113b9a service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.397747 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3f200f02-d427-4fc0-95b4-bbe6acf05eff req-7f158968-4341-4fd6-b578-b60017113b9a service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.413209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3f200f02-d427-4fc0-95b4-bbe6acf05eff req-7f158968-4341-4fd6-b578-b60017113b9a service nova] Creating event network-changed:b2f701f8-a237-4a6e-9896-f63fd717b63e for instance 19898312-d61b-457d-8217-d6c8e2ad2dbc on hv-cinder-82651 Sep 17 21:05:03.413707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3f200f02-d427-4fc0-95b4-bbe6acf05eff req-7f158968-4341-4fd6-b578-b60017113b9a service nova] Creating event network-changed:9475a995-1a52-4771-b571-1e84b3dbc2f6 for instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e on hv-cinder-82651 Sep 17 21:05:03.420865 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3f200f02-d427-4fc0-95b4-bbe6acf05eff req-7f158968-4341-4fd6-b578-b60017113b9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040489 Sep 17 21:05:03.422056 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 58/106] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:03.455939 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e0360617-e26c-4ac6-92ee-eae60f543422 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:03.456949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e0360617-e26c-4ac6-92ee-eae60f543422 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:03.463844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0360617-e26c-4ac6-92ee-eae60f543422 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.464454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0360617-e26c-4ac6-92ee-eae60f543422 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.464988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0360617-e26c-4ac6-92ee-eae60f543422 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.465939 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0360617-e26c-4ac6-92ee-eae60f543422 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.466473 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0360617-e26c-4ac6-92ee-eae60f543422 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.466967 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0360617-e26c-4ac6-92ee-eae60f543422 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.486078 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:03.579177 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4fc9f7aa-9bba-414d-9c4d-ff068bbaa895 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:03.580385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4fc9f7aa-9bba-414d-9c4d-ff068bbaa895 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:03.588591 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fc9f7aa-9bba-414d-9c4d-ff068bbaa895 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.589114 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fc9f7aa-9bba-414d-9c4d-ff068bbaa895 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.589549 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fc9f7aa-9bba-414d-9c4d-ff068bbaa895 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.590803 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fc9f7aa-9bba-414d-9c4d-ff068bbaa895 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.591267 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fc9f7aa-9bba-414d-9c4d-ff068bbaa895 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.591693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fc9f7aa-9bba-414d-9c4d-ff068bbaa895 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.694341 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e0360617-e26c-4ac6-92ee-eae60f543422 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:03.707341 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e0360617-e26c-4ac6-92ee-eae60f543422 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.254366 Sep 17 21:05:03.708026 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 49/107] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:03 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:03.713218 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2cc43981-514f-455c-954a-a971a108a4b2 req-edb13d18-2bfb-42b3-9f3f-71331a32ec9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b31e9e6-6a1c-44e8-bcdc-28130872f747", "tag": "8904efef-a53d-4fef-b879-3abe2ae8a7c4"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:03.723952 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2cc43981-514f-455c-954a-a971a108a4b2 req-edb13d18-2bfb-42b3-9f3f-71331a32ec9e service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.724809 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2cc43981-514f-455c-954a-a971a108a4b2 req-edb13d18-2bfb-42b3-9f3f-71331a32ec9e service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.725307 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2cc43981-514f-455c-954a-a971a108a4b2 req-edb13d18-2bfb-42b3-9f3f-71331a32ec9e service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.737509 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2cc43981-514f-455c-954a-a971a108a4b2 req-edb13d18-2bfb-42b3-9f3f-71331a32ec9e service nova] Creating event network-changed:8904efef-a53d-4fef-b879-3abe2ae8a7c4 for instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 on hv-cinder-82651 Sep 17 21:05:03.743470 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2cc43981-514f-455c-954a-a971a108a4b2 req-edb13d18-2bfb-42b3-9f3f-71331a32ec9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033509 Sep 17 21:05:03.744427 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 50/108] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:03.801122 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4fc9f7aa-9bba-414d-9c4d-ff068bbaa895 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:03.811711 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4fc9f7aa-9bba-414d-9c4d-ff068bbaa895 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.235120 Sep 17 21:05:03.812285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 59/109] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:03 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:04.398480 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-712d27a8-03f6-415f-9a6b-c2b1fd469f81 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:04.400197 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-712d27a8-03f6-415f-9a6b-c2b1fd469f81 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:04.402906 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3927b856-f6d1-4859-ab28-c9b589248acb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:04.403780 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3927b856-f6d1-4859-ab28-c9b589248acb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:04.407852 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-712d27a8-03f6-415f-9a6b-c2b1fd469f81 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.408341 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-712d27a8-03f6-415f-9a6b-c2b1fd469f81 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.408794 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-712d27a8-03f6-415f-9a6b-c2b1fd469f81 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.409494 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-712d27a8-03f6-415f-9a6b-c2b1fd469f81 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.410334 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3927b856-f6d1-4859-ab28-c9b589248acb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.411147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3927b856-f6d1-4859-ab28-c9b589248acb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.411744 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3927b856-f6d1-4859-ab28-c9b589248acb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.412452 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3927b856-f6d1-4859-ab28-c9b589248acb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.412933 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3927b856-f6d1-4859-ab28-c9b589248acb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.413494 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-712d27a8-03f6-415f-9a6b-c2b1fd469f81 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.413761 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3927b856-f6d1-4859-ab28-c9b589248acb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.414561 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-712d27a8-03f6-415f-9a6b-c2b1fd469f81 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.640546 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3927b856-f6d1-4859-ab28-c9b589248acb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:04.641058 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-712d27a8-03f6-415f-9a6b-c2b1fd469f81 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:04.648268 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3927b856-f6d1-4859-ab28-c9b589248acb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.250079 Sep 17 21:05:04.648865 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 60/110] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:04 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:04.651638 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-712d27a8-03f6-415f-9a6b-c2b1fd469f81 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.257593 Sep 17 21:05:04.652202 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 51/111] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:04 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:04.732417 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8450788d-ff19-44e9-8b13-10be9d2cc12f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:04.733299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8450788d-ff19-44e9-8b13-10be9d2cc12f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:04.739957 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8450788d-ff19-44e9-8b13-10be9d2cc12f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.740439 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8450788d-ff19-44e9-8b13-10be9d2cc12f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.740897 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8450788d-ff19-44e9-8b13-10be9d2cc12f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.741583 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8450788d-ff19-44e9-8b13-10be9d2cc12f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.742026 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8450788d-ff19-44e9-8b13-10be9d2cc12f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.742652 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8450788d-ff19-44e9-8b13-10be9d2cc12f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.837303 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5f944b4-548c-4895-991a-527780d5f6cf tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:04.837303 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5f944b4-548c-4895-991a-527780d5f6cf tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:04.844905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5f944b4-548c-4895-991a-527780d5f6cf tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.848041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5f944b4-548c-4895-991a-527780d5f6cf tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.849631 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5f944b4-548c-4895-991a-527780d5f6cf tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.850593 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5f944b4-548c-4895-991a-527780d5f6cf tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.852076 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5f944b4-548c-4895-991a-527780d5f6cf tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.853524 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5f944b4-548c-4895-991a-527780d5f6cf tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.894862 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8450788d-ff19-44e9-8b13-10be9d2cc12f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:04.906772 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8450788d-ff19-44e9-8b13-10be9d2cc12f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.179247 Sep 17 21:05:04.909089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 61/112] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:04 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:05.003580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f5f944b4-548c-4895-991a-527780d5f6cf tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:05.013423 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5f944b4-548c-4895-991a-527780d5f6cf tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.182014 Sep 17 21:05:05.014480 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 52/113] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:04 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:05.673022 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd889e59-d03d-440f-ab3c-242411fef8dc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:05.673640 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd889e59-d03d-440f-ab3c-242411fef8dc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:05.675458 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8229559-89d2-46d6-83a9-7a2db0edb5b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:05.676063 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8229559-89d2-46d6-83a9-7a2db0edb5b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:05.679487 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd889e59-d03d-440f-ab3c-242411fef8dc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.679965 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd889e59-d03d-440f-ab3c-242411fef8dc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.681111 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd889e59-d03d-440f-ab3c-242411fef8dc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.681809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd889e59-d03d-440f-ab3c-242411fef8dc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.682424 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd889e59-d03d-440f-ab3c-242411fef8dc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.682850 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd889e59-d03d-440f-ab3c-242411fef8dc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.683668 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8229559-89d2-46d6-83a9-7a2db0edb5b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.684155 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8229559-89d2-46d6-83a9-7a2db0edb5b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.684589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8229559-89d2-46d6-83a9-7a2db0edb5b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.685332 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8229559-89d2-46d6-83a9-7a2db0edb5b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.685767 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8229559-89d2-46d6-83a9-7a2db0edb5b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.686874 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8229559-89d2-46d6-83a9-7a2db0edb5b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.917853 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd889e59-d03d-440f-ab3c-242411fef8dc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:05.921132 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d8229559-89d2-46d6-83a9-7a2db0edb5b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:05.929056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8229559-89d2-46d6-83a9-7a2db0edb5b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.257210 Sep 17 21:05:05.932363 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd889e59-d03d-440f-ab3c-242411fef8dc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.264796 Sep 17 21:05:05.933336 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 53/114] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:05 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:05.935085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 62/115] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:05 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:05.955533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e5cc955-0fc5-43f3-82e8-7b1b9cf3c884 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:05.956154 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e5cc955-0fc5-43f3-82e8-7b1b9cf3c884 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:05.962371 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e5cc955-0fc5-43f3-82e8-7b1b9cf3c884 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.962861 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e5cc955-0fc5-43f3-82e8-7b1b9cf3c884 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.963299 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e5cc955-0fc5-43f3-82e8-7b1b9cf3c884 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.963988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e5cc955-0fc5-43f3-82e8-7b1b9cf3c884 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.964608 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e5cc955-0fc5-43f3-82e8-7b1b9cf3c884 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.965057 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e5cc955-0fc5-43f3-82e8-7b1b9cf3c884 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.042866 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec63b970-73ba-4a66-83d2-fe93dbfb04ef tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:06.043898 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec63b970-73ba-4a66-83d2-fe93dbfb04ef tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:06.052960 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec63b970-73ba-4a66-83d2-fe93dbfb04ef tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.053642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec63b970-73ba-4a66-83d2-fe93dbfb04ef tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.054379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec63b970-73ba-4a66-83d2-fe93dbfb04ef tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.055816 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec63b970-73ba-4a66-83d2-fe93dbfb04ef tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.056753 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec63b970-73ba-4a66-83d2-fe93dbfb04ef tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.057375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec63b970-73ba-4a66-83d2-fe93dbfb04ef tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.165340 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e5cc955-0fc5-43f3-82e8-7b1b9cf3c884 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:06.178134 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e5cc955-0fc5-43f3-82e8-7b1b9cf3c884 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.243490 Sep 17 21:05:06.179765 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 54/116] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:05 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:06.252975 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ec63b970-73ba-4a66-83d2-fe93dbfb04ef tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:06.264090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec63b970-73ba-4a66-83d2-fe93dbfb04ef tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.229468 Sep 17 21:05:06.265560 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 63/117] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:06 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:06.958872 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc40f593-f4cc-4042-a5de-5faa247dd2ba tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:06.959346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca234f4a-aac9-437e-b73a-5887729f8abf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:06.959692 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc40f593-f4cc-4042-a5de-5faa247dd2ba tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:06.959768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ca234f4a-aac9-437e-b73a-5887729f8abf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:06.966479 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc40f593-f4cc-4042-a5de-5faa247dd2ba tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.967793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc40f593-f4cc-4042-a5de-5faa247dd2ba tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.968226 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc40f593-f4cc-4042-a5de-5faa247dd2ba tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.968598 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca234f4a-aac9-437e-b73a-5887729f8abf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.968940 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc40f593-f4cc-4042-a5de-5faa247dd2ba tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.969127 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca234f4a-aac9-437e-b73a-5887729f8abf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.969572 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca234f4a-aac9-437e-b73a-5887729f8abf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.969921 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc40f593-f4cc-4042-a5de-5faa247dd2ba tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.970409 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc40f593-f4cc-4042-a5de-5faa247dd2ba tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.970560 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca234f4a-aac9-437e-b73a-5887729f8abf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.971187 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca234f4a-aac9-437e-b73a-5887729f8abf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.971612 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca234f4a-aac9-437e-b73a-5887729f8abf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.165528 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc40f593-f4cc-4042-a5de-5faa247dd2ba tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:07.169670 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ca234f4a-aac9-437e-b73a-5887729f8abf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:07.173471 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc40f593-f4cc-4042-a5de-5faa247dd2ba tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.218757 Sep 17 21:05:07.179747 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ca234f4a-aac9-437e-b73a-5887729f8abf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.224578 Sep 17 21:05:07.189952 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 55/118] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:06 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:07.192980 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 64/119] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:06 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:07.204444 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32d51974-542e-49d9-ab9d-0f9e650faf9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:07.205095 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32d51974-542e-49d9-ab9d-0f9e650faf9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:07.211183 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32d51974-542e-49d9-ab9d-0f9e650faf9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.212264 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32d51974-542e-49d9-ab9d-0f9e650faf9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.212748 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32d51974-542e-49d9-ab9d-0f9e650faf9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.213425 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32d51974-542e-49d9-ab9d-0f9e650faf9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.213888 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32d51974-542e-49d9-ab9d-0f9e650faf9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.214310 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32d51974-542e-49d9-ab9d-0f9e650faf9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.290851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae97d22b-9a87-464b-9d3e-1730fd383978 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:07.291823 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae97d22b-9a87-464b-9d3e-1730fd383978 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:07.303972 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae97d22b-9a87-464b-9d3e-1730fd383978 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.304877 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae97d22b-9a87-464b-9d3e-1730fd383978 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.306302 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae97d22b-9a87-464b-9d3e-1730fd383978 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.307289 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae97d22b-9a87-464b-9d3e-1730fd383978 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.309136 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae97d22b-9a87-464b-9d3e-1730fd383978 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.309728 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae97d22b-9a87-464b-9d3e-1730fd383978 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.391777 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-32d51974-542e-49d9-ab9d-0f9e650faf9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:07.402905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32d51974-542e-49d9-ab9d-0f9e650faf9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.203566 Sep 17 21:05:07.404056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 56/120] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:07 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:07.505889 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae97d22b-9a87-464b-9d3e-1730fd383978 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:07.514073 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae97d22b-9a87-464b-9d3e-1730fd383978 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.230485 Sep 17 21:05:07.514644 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 65/121] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:07 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:08.200381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-828595be-eda8-4091-b7e3-8cbc8fc05162 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:08.201901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-828595be-eda8-4091-b7e3-8cbc8fc05162 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:08.203916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-069bb41c-7c02-4f1d-8b05-6f59c90afc55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:08.205520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-069bb41c-7c02-4f1d-8b05-6f59c90afc55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:08.209826 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828595be-eda8-4091-b7e3-8cbc8fc05162 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.210691 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828595be-eda8-4091-b7e3-8cbc8fc05162 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.211361 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828595be-eda8-4091-b7e3-8cbc8fc05162 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.212298 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828595be-eda8-4091-b7e3-8cbc8fc05162 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.212989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828595be-eda8-4091-b7e3-8cbc8fc05162 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.213576 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828595be-eda8-4091-b7e3-8cbc8fc05162 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.213682 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-069bb41c-7c02-4f1d-8b05-6f59c90afc55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.214313 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-069bb41c-7c02-4f1d-8b05-6f59c90afc55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.214762 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-069bb41c-7c02-4f1d-8b05-6f59c90afc55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.215911 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-069bb41c-7c02-4f1d-8b05-6f59c90afc55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.216596 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-069bb41c-7c02-4f1d-8b05-6f59c90afc55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.217261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-069bb41c-7c02-4f1d-8b05-6f59c90afc55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.428656 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-069bb41c-7c02-4f1d-8b05-6f59c90afc55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.440080 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-069bb41c-7c02-4f1d-8b05-6f59c90afc55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.240903 Sep 17 21:05:08.440660 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 66/122] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:08 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:08.449322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a9b1ece-6285-4a7b-84a8-79e5784e230a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:08.450223 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7a9b1ece-6285-4a7b-84a8-79e5784e230a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:08.458299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a9b1ece-6285-4a7b-84a8-79e5784e230a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.459138 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a9b1ece-6285-4a7b-84a8-79e5784e230a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.460059 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a9b1ece-6285-4a7b-84a8-79e5784e230a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.461763 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a9b1ece-6285-4a7b-84a8-79e5784e230a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.462247 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a9b1ece-6285-4a7b-84a8-79e5784e230a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.462683 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a9b1ece-6285-4a7b-84a8-79e5784e230a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.462913 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-828595be-eda8-4091-b7e3-8cbc8fc05162 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.470530 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-828595be-eda8-4091-b7e3-8cbc8fc05162 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.276931 Sep 17 21:05:08.471090 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 57/123] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:08 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:08.536559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ced3c8be-b732-4812-995c-a6749ae7f0fb tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:08.537468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ced3c8be-b732-4812-995c-a6749ae7f0fb tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:08.543832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ced3c8be-b732-4812-995c-a6749ae7f0fb tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.544304 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ced3c8be-b732-4812-995c-a6749ae7f0fb tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.544766 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ced3c8be-b732-4812-995c-a6749ae7f0fb tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.545459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ced3c8be-b732-4812-995c-a6749ae7f0fb tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.545910 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ced3c8be-b732-4812-995c-a6749ae7f0fb tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.546325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ced3c8be-b732-4812-995c-a6749ae7f0fb tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.634210 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7a9b1ece-6285-4a7b-84a8-79e5784e230a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.643327 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7a9b1ece-6285-4a7b-84a8-79e5784e230a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.201204 Sep 17 21:05:08.644130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 67/124] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:08 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:08.700360 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ced3c8be-b732-4812-995c-a6749ae7f0fb tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.710297 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ced3c8be-b732-4812-995c-a6749ae7f0fb tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.177439 Sep 17 21:05:08.710954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 58/125] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:08 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:09.464050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dcf307ff-a9e3-4e02-8caf-0b3fcc21b94e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:09.464696 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dcf307ff-a9e3-4e02-8caf-0b3fcc21b94e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:09.470873 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcf307ff-a9e3-4e02-8caf-0b3fcc21b94e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.471356 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcf307ff-a9e3-4e02-8caf-0b3fcc21b94e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.471793 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcf307ff-a9e3-4e02-8caf-0b3fcc21b94e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.472481 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcf307ff-a9e3-4e02-8caf-0b3fcc21b94e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.473087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcf307ff-a9e3-4e02-8caf-0b3fcc21b94e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.473617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcf307ff-a9e3-4e02-8caf-0b3fcc21b94e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.495315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df9c891e-5b27-4596-8c2c-155b1c479030 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:09.495927 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-df9c891e-5b27-4596-8c2c-155b1c479030 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:09.502751 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df9c891e-5b27-4596-8c2c-155b1c479030 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.503570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df9c891e-5b27-4596-8c2c-155b1c479030 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.504184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df9c891e-5b27-4596-8c2c-155b1c479030 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.505135 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df9c891e-5b27-4596-8c2c-155b1c479030 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.505587 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df9c891e-5b27-4596-8c2c-155b1c479030 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.506016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df9c891e-5b27-4596-8c2c-155b1c479030 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.710476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-dcf307ff-a9e3-4e02-8caf-0b3fcc21b94e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:09.719643 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dcf307ff-a9e3-4e02-8caf-0b3fcc21b94e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.259909 Sep 17 21:05:09.720292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 68/126] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:09 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:09.738398 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-df9c891e-5b27-4596-8c2c-155b1c479030 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:09.741209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a5d468dd-a30d-44cc-97f2-485a03707a55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:09.741813 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a5d468dd-a30d-44cc-97f2-485a03707a55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:09.746988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df9c891e-5b27-4596-8c2c-155b1c479030 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.257783 Sep 17 21:05:09.747579 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 59/127] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:09 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:09.752266 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e7bfd4f-a004-4964-bd6a-9ad959862f5a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:09.752968 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8e7bfd4f-a004-4964-bd6a-9ad959862f5a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:09.759525 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e7bfd4f-a004-4964-bd6a-9ad959862f5a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.760115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e7bfd4f-a004-4964-bd6a-9ad959862f5a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.760616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e7bfd4f-a004-4964-bd6a-9ad959862f5a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.761415 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e7bfd4f-a004-4964-bd6a-9ad959862f5a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.761941 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e7bfd4f-a004-4964-bd6a-9ad959862f5a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.762066 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d468dd-a30d-44cc-97f2-485a03707a55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.762463 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e7bfd4f-a004-4964-bd6a-9ad959862f5a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.762555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d468dd-a30d-44cc-97f2-485a03707a55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.762906 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d468dd-a30d-44cc-97f2-485a03707a55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.763603 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d468dd-a30d-44cc-97f2-485a03707a55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.764071 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d468dd-a30d-44cc-97f2-485a03707a55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.764468 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d468dd-a30d-44cc-97f2-485a03707a55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.132886 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8e7bfd4f-a004-4964-bd6a-9ad959862f5a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:10.142339 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8e7bfd4f-a004-4964-bd6a-9ad959862f5a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.393399 Sep 17 21:05:10.142994 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 60/128] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:09 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:10.153425 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a5d468dd-a30d-44cc-97f2-485a03707a55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:10.153425 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a5d468dd-a30d-44cc-97f2-485a03707a55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.417533 Sep 17 21:05:10.153425 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 69/129] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:09 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:10.746254 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c42e976f-d92f-4285-aa0b-4c7f4077bbba tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:10.746898 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c42e976f-d92f-4285-aa0b-4c7f4077bbba tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:10.753593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42e976f-d92f-4285-aa0b-4c7f4077bbba tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:10.754066 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42e976f-d92f-4285-aa0b-4c7f4077bbba tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:10.754764 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42e976f-d92f-4285-aa0b-4c7f4077bbba tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.755450 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42e976f-d92f-4285-aa0b-4c7f4077bbba tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:10.756000 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42e976f-d92f-4285-aa0b-4c7f4077bbba tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:10.756421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42e976f-d92f-4285-aa0b-4c7f4077bbba tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.774802 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea8f7601-7a43-471e-89e0-60b97c2a0742 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:10.775229 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea8f7601-7a43-471e-89e0-60b97c2a0742 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:10.782119 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea8f7601-7a43-471e-89e0-60b97c2a0742 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:10.782841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea8f7601-7a43-471e-89e0-60b97c2a0742 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:10.783311 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea8f7601-7a43-471e-89e0-60b97c2a0742 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.784016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea8f7601-7a43-471e-89e0-60b97c2a0742 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:10.784896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea8f7601-7a43-471e-89e0-60b97c2a0742 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:10.785593 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea8f7601-7a43-471e-89e0-60b97c2a0742 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.970938 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c42e976f-d92f-4285-aa0b-4c7f4077bbba tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:10.973945 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea8f7601-7a43-471e-89e0-60b97c2a0742 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:10.979194 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c42e976f-d92f-4285-aa0b-4c7f4077bbba tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.237447 Sep 17 21:05:10.980374 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 70/130] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:10 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:10.983167 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea8f7601-7a43-471e-89e0-60b97c2a0742 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.212580 Sep 17 21:05:10.984262 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 61/131] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:10 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:11.166786 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71377a41-8eab-4270-82d5-b2d4c0910bbc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:11.167399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-71377a41-8eab-4270-82d5-b2d4c0910bbc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:11.174140 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71377a41-8eab-4270-82d5-b2d4c0910bbc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:11.174537 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71377a41-8eab-4270-82d5-b2d4c0910bbc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:11.174971 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71377a41-8eab-4270-82d5-b2d4c0910bbc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:11.175665 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71377a41-8eab-4270-82d5-b2d4c0910bbc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:11.176176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71377a41-8eab-4270-82d5-b2d4c0910bbc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:11.176511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71377a41-8eab-4270-82d5-b2d4c0910bbc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:11.177710 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fe38427f-988d-4487-a060-ecb4183789f7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:11.178321 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fe38427f-988d-4487-a060-ecb4183789f7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:11.191254 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe38427f-988d-4487-a060-ecb4183789f7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:11.191982 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe38427f-988d-4487-a060-ecb4183789f7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:11.192545 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe38427f-988d-4487-a060-ecb4183789f7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:11.193547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe38427f-988d-4487-a060-ecb4183789f7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:11.194165 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe38427f-988d-4487-a060-ecb4183789f7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:11.194958 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe38427f-988d-4487-a060-ecb4183789f7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:11.341314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:11.447081 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:11.452260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fe38427f-988d-4487-a060-ecb4183789f7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:11.455308 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-71377a41-8eab-4270-82d5-b2d4c0910bbc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:11.461008 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fe38427f-988d-4487-a060-ecb4183789f7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.289563 Sep 17 21:05:11.462206 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 62/132] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:11 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:11.482258 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-71377a41-8eab-4270-82d5-b2d4c0910bbc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.320537 Sep 17 21:05:11.483180 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 71/133] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:11 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:12.003193 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7731dc0e-0537-41a7-93db-a71f504e40f4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:12.003798 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7731dc0e-0537-41a7-93db-a71f504e40f4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:12.006733 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-160aff22-951d-49d3-b111-788463c7ae37 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:12.007155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-160aff22-951d-49d3-b111-788463c7ae37 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:12.010621 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7731dc0e-0537-41a7-93db-a71f504e40f4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.011110 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7731dc0e-0537-41a7-93db-a71f504e40f4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.011537 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7731dc0e-0537-41a7-93db-a71f504e40f4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.012225 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7731dc0e-0537-41a7-93db-a71f504e40f4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.012691 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7731dc0e-0537-41a7-93db-a71f504e40f4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.013119 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7731dc0e-0537-41a7-93db-a71f504e40f4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.014760 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-160aff22-951d-49d3-b111-788463c7ae37 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.015247 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-160aff22-951d-49d3-b111-788463c7ae37 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.015665 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-160aff22-951d-49d3-b111-788463c7ae37 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.016356 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-160aff22-951d-49d3-b111-788463c7ae37 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.018159 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-160aff22-951d-49d3-b111-788463c7ae37 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.018159 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-160aff22-951d-49d3-b111-788463c7ae37 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.220991 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7731dc0e-0537-41a7-93db-a71f504e40f4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:12.223962 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-160aff22-951d-49d3-b111-788463c7ae37 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:12.230009 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7731dc0e-0537-41a7-93db-a71f504e40f4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.230615 Sep 17 21:05:12.236854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 63/134] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:11 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:12.237117 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-160aff22-951d-49d3-b111-788463c7ae37 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.230492 Sep 17 21:05:12.237117 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 72/135] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:12 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:12.483387 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1063ecd5-5685-453d-885f-1357e5c26f25 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:12.484060 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1063ecd5-5685-453d-885f-1357e5c26f25 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:12.490159 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1063ecd5-5685-453d-885f-1357e5c26f25 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.490641 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1063ecd5-5685-453d-885f-1357e5c26f25 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.491074 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1063ecd5-5685-453d-885f-1357e5c26f25 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.491762 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1063ecd5-5685-453d-885f-1357e5c26f25 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.492212 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1063ecd5-5685-453d-885f-1357e5c26f25 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.493242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1063ecd5-5685-453d-885f-1357e5c26f25 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.505440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e6631dc-02fa-4d63-93a4-edf893a7a08c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:12.506038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3e6631dc-02fa-4d63-93a4-edf893a7a08c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:12.513131 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e6631dc-02fa-4d63-93a4-edf893a7a08c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.513615 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e6631dc-02fa-4d63-93a4-edf893a7a08c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.514038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e6631dc-02fa-4d63-93a4-edf893a7a08c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.514736 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e6631dc-02fa-4d63-93a4-edf893a7a08c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.515185 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e6631dc-02fa-4d63-93a4-edf893a7a08c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.515603 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e6631dc-02fa-4d63-93a4-edf893a7a08c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.689908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1063ecd5-5685-453d-885f-1357e5c26f25 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:12.699151 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1063ecd5-5685-453d-885f-1357e5c26f25 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.219590 Sep 17 21:05:12.700029 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 64/136] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:12 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:12.710161 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3e6631dc-02fa-4d63-93a4-edf893a7a08c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:12.719971 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3e6631dc-02fa-4d63-93a4-edf893a7a08c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.218244 Sep 17 21:05:12.720541 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 73/137] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:12 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:13.253441 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7475faa1-0602-43c9-9703-eeaf143b9b10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:13.254049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7475faa1-0602-43c9-9703-eeaf143b9b10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:13.255235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5ff8b02d-b89a-4e5e-8dbf-84543b996d75 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:13.255844 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5ff8b02d-b89a-4e5e-8dbf-84543b996d75 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:13.260002 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7475faa1-0602-43c9-9703-eeaf143b9b10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.260490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7475faa1-0602-43c9-9703-eeaf143b9b10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.260955 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7475faa1-0602-43c9-9703-eeaf143b9b10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.261645 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7475faa1-0602-43c9-9703-eeaf143b9b10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.262095 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7475faa1-0602-43c9-9703-eeaf143b9b10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.262447 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ff8b02d-b89a-4e5e-8dbf-84543b996d75 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.262570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7475faa1-0602-43c9-9703-eeaf143b9b10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.262939 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ff8b02d-b89a-4e5e-8dbf-84543b996d75 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.263358 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ff8b02d-b89a-4e5e-8dbf-84543b996d75 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.264048 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ff8b02d-b89a-4e5e-8dbf-84543b996d75 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.264496 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ff8b02d-b89a-4e5e-8dbf-84543b996d75 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.264966 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ff8b02d-b89a-4e5e-8dbf-84543b996d75 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.269164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:13.455066 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7475faa1-0602-43c9-9703-eeaf143b9b10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:13.464849 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7475faa1-0602-43c9-9703-eeaf143b9b10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.215145 Sep 17 21:05:13.467917 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5ff8b02d-b89a-4e5e-8dbf-84543b996d75 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:13.469173 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 65/138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:13 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:13.478080 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5ff8b02d-b89a-4e5e-8dbf-84543b996d75 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.226431 Sep 17 21:05:13.478832 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 74/139] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:13 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:13.723123 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-982ec815-2c32-4303-afb0-8dcf5484339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:13.723735 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-982ec815-2c32-4303-afb0-8dcf5484339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:13.730232 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982ec815-2c32-4303-afb0-8dcf5484339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.730711 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982ec815-2c32-4303-afb0-8dcf5484339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.731144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982ec815-2c32-4303-afb0-8dcf5484339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.731829 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982ec815-2c32-4303-afb0-8dcf5484339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.732290 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982ec815-2c32-4303-afb0-8dcf5484339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.732761 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982ec815-2c32-4303-afb0-8dcf5484339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.742909 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-217f7149-80a1-48b7-a978-d6256e45e549 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:13.743520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-217f7149-80a1-48b7-a978-d6256e45e549 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:13.749582 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-217f7149-80a1-48b7-a978-d6256e45e549 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.750061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-217f7149-80a1-48b7-a978-d6256e45e549 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.750489 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-217f7149-80a1-48b7-a978-d6256e45e549 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.751173 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-217f7149-80a1-48b7-a978-d6256e45e549 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.751615 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-217f7149-80a1-48b7-a978-d6256e45e549 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.752248 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-217f7149-80a1-48b7-a978-d6256e45e549 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.934206 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-982ec815-2c32-4303-afb0-8dcf5484339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:13.938461 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:13.940924 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-217f7149-80a1-48b7-a978-d6256e45e549 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:13.943658 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-982ec815-2c32-4303-afb0-8dcf5484339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.224238 Sep 17 21:05:13.944231 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 66/140] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:13 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:13.952877 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-217f7149-80a1-48b7-a978-d6256e45e549 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.213748 Sep 17 21:05:13.953890 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 75/141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:13 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:14.487368 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07b38606-99fa-4853-b7aa-cd07a3a5998f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:14.487975 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07b38606-99fa-4853-b7aa-cd07a3a5998f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:14.494293 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07b38606-99fa-4853-b7aa-cd07a3a5998f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.494769 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07b38606-99fa-4853-b7aa-cd07a3a5998f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.495202 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07b38606-99fa-4853-b7aa-cd07a3a5998f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.495966 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07b38606-99fa-4853-b7aa-cd07a3a5998f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.496418 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07b38606-99fa-4853-b7aa-cd07a3a5998f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.496867 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07b38606-99fa-4853-b7aa-cd07a3a5998f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.501003 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-227eca7b-c8bd-4012-a028-0635c8117ace tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:14.501646 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-227eca7b-c8bd-4012-a028-0635c8117ace tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:14.507440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-227eca7b-c8bd-4012-a028-0635c8117ace tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.508158 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-227eca7b-c8bd-4012-a028-0635c8117ace tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.508517 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-227eca7b-c8bd-4012-a028-0635c8117ace tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.509238 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-227eca7b-c8bd-4012-a028-0635c8117ace tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.509692 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-227eca7b-c8bd-4012-a028-0635c8117ace tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.510118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-227eca7b-c8bd-4012-a028-0635c8117ace tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.691969 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-07b38606-99fa-4853-b7aa-cd07a3a5998f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:14.696152 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-227eca7b-c8bd-4012-a028-0635c8117ace tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:14.699993 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07b38606-99fa-4853-b7aa-cd07a3a5998f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.216383 Sep 17 21:05:14.700589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 67/142] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:14 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:14.704438 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-227eca7b-c8bd-4012-a028-0635c8117ace tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.207180 Sep 17 21:05:14.705013 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 76/143] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:14 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:14.976070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-caa6fcf3-c1cd-4cbb-b6d7-ab7a849dc37a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:14.976742 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-caa6fcf3-c1cd-4cbb-b6d7-ab7a849dc37a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:14.982166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-693a18e2-dd66-4e5e-92e1-e0aee5adca46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:14.982712 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-caa6fcf3-c1cd-4cbb-b6d7-ab7a849dc37a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.982860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-693a18e2-dd66-4e5e-92e1-e0aee5adca46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:14.983195 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-caa6fcf3-c1cd-4cbb-b6d7-ab7a849dc37a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.983661 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-caa6fcf3-c1cd-4cbb-b6d7-ab7a849dc37a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.984350 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-caa6fcf3-c1cd-4cbb-b6d7-ab7a849dc37a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.984828 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-caa6fcf3-c1cd-4cbb-b6d7-ab7a849dc37a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.985248 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-caa6fcf3-c1cd-4cbb-b6d7-ab7a849dc37a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.989316 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-693a18e2-dd66-4e5e-92e1-e0aee5adca46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.989790 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-693a18e2-dd66-4e5e-92e1-e0aee5adca46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.990221 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-693a18e2-dd66-4e5e-92e1-e0aee5adca46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.990912 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-693a18e2-dd66-4e5e-92e1-e0aee5adca46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.991657 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-693a18e2-dd66-4e5e-92e1-e0aee5adca46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.992079 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-693a18e2-dd66-4e5e-92e1-e0aee5adca46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:15.185477 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-caa6fcf3-c1cd-4cbb-b6d7-ab7a849dc37a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:15.191782 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-693a18e2-dd66-4e5e-92e1-e0aee5adca46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:15.201702 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-caa6fcf3-c1cd-4cbb-b6d7-ab7a849dc37a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.226142 Sep 17 21:05:15.203353 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 68/144] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:14 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:15.207291 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-693a18e2-dd66-4e5e-92e1-e0aee5adca46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.229115 Sep 17 21:05:15.208005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 77/145] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:14 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:15.722869 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fa5d212c-d047-4d07-98de-08c6e3537d69 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:15.724096 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fa5d212c-d047-4d07-98de-08c6e3537d69 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:15.729015 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4eb2fdd0-9419-415b-9eb0-84137e743425 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:15.730112 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4eb2fdd0-9419-415b-9eb0-84137e743425 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:15.731810 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa5d212c-d047-4d07-98de-08c6e3537d69 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:15.732293 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa5d212c-d047-4d07-98de-08c6e3537d69 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:15.732767 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa5d212c-d047-4d07-98de-08c6e3537d69 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:15.734221 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa5d212c-d047-4d07-98de-08c6e3537d69 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:15.734677 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa5d212c-d047-4d07-98de-08c6e3537d69 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:15.735101 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa5d212c-d047-4d07-98de-08c6e3537d69 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:15.736867 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4eb2fdd0-9419-415b-9eb0-84137e743425 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:15.737548 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4eb2fdd0-9419-415b-9eb0-84137e743425 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:15.738166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4eb2fdd0-9419-415b-9eb0-84137e743425 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:15.739018 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4eb2fdd0-9419-415b-9eb0-84137e743425 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:15.739800 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4eb2fdd0-9419-415b-9eb0-84137e743425 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:15.740226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4eb2fdd0-9419-415b-9eb0-84137e743425 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:15.932001 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fa5d212c-d047-4d07-98de-08c6e3537d69 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:15.937941 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4eb2fdd0-9419-415b-9eb0-84137e743425 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:15.940283 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fa5d212c-d047-4d07-98de-08c6e3537d69 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.221415 Sep 17 21:05:15.940888 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 69/146] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:15 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:15.946411 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4eb2fdd0-9419-415b-9eb0-84137e743425 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.221652 Sep 17 21:05:15.947299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 78/147] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:15 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:16.225928 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-29775621-aaab-4f50-8b1f-e343fcda84c1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:16.226536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-29775621-aaab-4f50-8b1f-e343fcda84c1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:16.233320 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29775621-aaab-4f50-8b1f-e343fcda84c1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:16.233802 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-39a93a7e-22b5-4efe-a8bb-d72037d8c7e1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:16.233935 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29775621-aaab-4f50-8b1f-e343fcda84c1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:16.234235 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29775621-aaab-4f50-8b1f-e343fcda84c1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:16.234568 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-39a93a7e-22b5-4efe-a8bb-d72037d8c7e1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:16.234931 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29775621-aaab-4f50-8b1f-e343fcda84c1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:16.235414 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29775621-aaab-4f50-8b1f-e343fcda84c1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:16.235855 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29775621-aaab-4f50-8b1f-e343fcda84c1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:16.240834 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39a93a7e-22b5-4efe-a8bb-d72037d8c7e1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:16.241613 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39a93a7e-22b5-4efe-a8bb-d72037d8c7e1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:16.242212 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39a93a7e-22b5-4efe-a8bb-d72037d8c7e1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:16.243074 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39a93a7e-22b5-4efe-a8bb-d72037d8c7e1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:16.244136 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39a93a7e-22b5-4efe-a8bb-d72037d8c7e1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:16.245220 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39a93a7e-22b5-4efe-a8bb-d72037d8c7e1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:16.455966 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-29775621-aaab-4f50-8b1f-e343fcda84c1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:16.459949 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-39a93a7e-22b5-4efe-a8bb-d72037d8c7e1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:16.465111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-29775621-aaab-4f50-8b1f-e343fcda84c1 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.242957 Sep 17 21:05:16.465683 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 70/148] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:16 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:16.468172 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-39a93a7e-22b5-4efe-a8bb-d72037d8c7e1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.238132 Sep 17 21:05:16.468788 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 79/149] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:16 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:16.963998 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-05fed949-183d-482a-8d22-9dc979e02912 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:16.964628 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-05fed949-183d-482a-8d22-9dc979e02912 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:16.970507 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-276b8e2f-d6be-47ee-9683-ac9ed753f7df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:16.971021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05fed949-183d-482a-8d22-9dc979e02912 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:16.971021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05fed949-183d-482a-8d22-9dc979e02912 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:16.971224 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-276b8e2f-d6be-47ee-9683-ac9ed753f7df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:16.971453 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05fed949-183d-482a-8d22-9dc979e02912 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:16.972136 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05fed949-183d-482a-8d22-9dc979e02912 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:16.972581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05fed949-183d-482a-8d22-9dc979e02912 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:16.973019 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05fed949-183d-482a-8d22-9dc979e02912 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:16.977125 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-276b8e2f-d6be-47ee-9683-ac9ed753f7df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:16.977600 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-276b8e2f-d6be-47ee-9683-ac9ed753f7df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:16.978032 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-276b8e2f-d6be-47ee-9683-ac9ed753f7df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:16.978713 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-276b8e2f-d6be-47ee-9683-ac9ed753f7df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:16.979161 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-276b8e2f-d6be-47ee-9683-ac9ed753f7df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:16.979575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-276b8e2f-d6be-47ee-9683-ac9ed753f7df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.154220 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-05fed949-183d-482a-8d22-9dc979e02912 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:17.161865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-05fed949-183d-482a-8d22-9dc979e02912 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.201724 Sep 17 21:05:17.162557 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 71/150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:16 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:17.167995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-276b8e2f-d6be-47ee-9683-ac9ed753f7df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:17.175518 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-276b8e2f-d6be-47ee-9683-ac9ed753f7df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.208773 Sep 17 21:05:17.176058 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 80/151] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:16 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:17.487124 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3a651524-3293-47fe-9fd2-03e948eecfec tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:17.487729 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3a651524-3293-47fe-9fd2-03e948eecfec tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:17.490257 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b4336df0-ceb5-4962-8b68-77daa34530f2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:17.490861 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b4336df0-ceb5-4962-8b68-77daa34530f2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:17.493700 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a651524-3293-47fe-9fd2-03e948eecfec tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.494179 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a651524-3293-47fe-9fd2-03e948eecfec tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.494606 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a651524-3293-47fe-9fd2-03e948eecfec tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.495284 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a651524-3293-47fe-9fd2-03e948eecfec tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.495728 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a651524-3293-47fe-9fd2-03e948eecfec tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.496144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a651524-3293-47fe-9fd2-03e948eecfec tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.496881 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4336df0-ceb5-4962-8b68-77daa34530f2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.497359 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4336df0-ceb5-4962-8b68-77daa34530f2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.497787 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4336df0-ceb5-4962-8b68-77daa34530f2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.498469 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4336df0-ceb5-4962-8b68-77daa34530f2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.498916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4336df0-ceb5-4962-8b68-77daa34530f2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.499333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4336df0-ceb5-4962-8b68-77daa34530f2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.854048 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3a651524-3293-47fe-9fd2-03e948eecfec tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:17.856925 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b4336df0-ceb5-4962-8b68-77daa34530f2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:17.862048 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3a651524-3293-47fe-9fd2-03e948eecfec tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.378658 Sep 17 21:05:17.862700 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 72/152] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:17 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:17.864466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b4336df0-ceb5-4962-8b68-77daa34530f2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.378000 Sep 17 21:05:17.865048 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 81/153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:17 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:18.184862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-263f4aae-c995-4a3c-acc6-24d9b1f72734 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:18.185464 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-263f4aae-c995-4a3c-acc6-24d9b1f72734 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:18.187297 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=87 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:18.192499 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-263f4aae-c995-4a3c-acc6-24d9b1f72734 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.193084 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-263f4aae-c995-4a3c-acc6-24d9b1f72734 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.193516 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-263f4aae-c995-4a3c-acc6-24d9b1f72734 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:18.194211 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-263f4aae-c995-4a3c-acc6-24d9b1f72734 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.194772 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-263f4aae-c995-4a3c-acc6-24d9b1f72734 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.195193 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-263f4aae-c995-4a3c-acc6-24d9b1f72734 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:18.199860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2bf20b62-017e-4d0c-ba65-cdedcdc78ec3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:18.200616 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2bf20b62-017e-4d0c-ba65-cdedcdc78ec3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:18.206438 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bf20b62-017e-4d0c-ba65-cdedcdc78ec3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.206920 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bf20b62-017e-4d0c-ba65-cdedcdc78ec3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.207349 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bf20b62-017e-4d0c-ba65-cdedcdc78ec3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:18.208069 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bf20b62-017e-4d0c-ba65-cdedcdc78ec3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.208523 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bf20b62-017e-4d0c-ba65-cdedcdc78ec3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.208995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bf20b62-017e-4d0c-ba65-cdedcdc78ec3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:18.382625 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-263f4aae-c995-4a3c-acc6-24d9b1f72734 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:18.393192 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-263f4aae-c995-4a3c-acc6-24d9b1f72734 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.212007 Sep 17 21:05:18.394083 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 73/154] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:18 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:18.398628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2bf20b62-017e-4d0c-ba65-cdedcdc78ec3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:18.406782 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2bf20b62-017e-4d0c-ba65-cdedcdc78ec3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.212657 Sep 17 21:05:18.407337 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 82/155] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:18 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:18.884944 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-24f60d22-2b9f-48a0-9716-f0d8ffaa495b tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:18.885542 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-24f60d22-2b9f-48a0-9716-f0d8ffaa495b tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:18.886932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da49ada2-f60d-403a-9961-d3c769db2998 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:18.887542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da49ada2-f60d-403a-9961-d3c769db2998 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:18.891435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24f60d22-2b9f-48a0-9716-f0d8ffaa495b tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.891910 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24f60d22-2b9f-48a0-9716-f0d8ffaa495b tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.892336 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24f60d22-2b9f-48a0-9716-f0d8ffaa495b tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:18.893037 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24f60d22-2b9f-48a0-9716-f0d8ffaa495b tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.893347 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da49ada2-f60d-403a-9961-d3c769db2998 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.893486 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24f60d22-2b9f-48a0-9716-f0d8ffaa495b tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.893828 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da49ada2-f60d-403a-9961-d3c769db2998 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.893954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24f60d22-2b9f-48a0-9716-f0d8ffaa495b tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:18.894275 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da49ada2-f60d-403a-9961-d3c769db2998 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:18.894947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da49ada2-f60d-403a-9961-d3c769db2998 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.895406 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da49ada2-f60d-403a-9961-d3c769db2998 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.895825 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da49ada2-f60d-403a-9961-d3c769db2998 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:19.080056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-24f60d22-2b9f-48a0-9716-f0d8ffaa495b tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:19.087678 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-da49ada2-f60d-403a-9961-d3c769db2998 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:19.088184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-24f60d22-2b9f-48a0-9716-f0d8ffaa495b tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.207410 Sep 17 21:05:19.088771 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 74/156] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:18 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:19.095341 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da49ada2-f60d-403a-9961-d3c769db2998 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.212274 Sep 17 21:05:19.095891 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 83/157] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:18 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:19.415319 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce93f1d6-7938-414d-a88c-8a16b5a91526 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:19.415927 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce93f1d6-7938-414d-a88c-8a16b5a91526 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:19.422034 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce93f1d6-7938-414d-a88c-8a16b5a91526 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:19.422514 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce93f1d6-7938-414d-a88c-8a16b5a91526 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:19.422945 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce93f1d6-7938-414d-a88c-8a16b5a91526 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:19.423631 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce93f1d6-7938-414d-a88c-8a16b5a91526 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:19.424085 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce93f1d6-7938-414d-a88c-8a16b5a91526 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:19.424593 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce93f1d6-7938-414d-a88c-8a16b5a91526 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:19.429528 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8ff0a57-1a9c-40b4-87a7-2f5cfc6b5e02 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:19.430465 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8ff0a57-1a9c-40b4-87a7-2f5cfc6b5e02 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:19.436216 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8ff0a57-1a9c-40b4-87a7-2f5cfc6b5e02 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:19.436729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8ff0a57-1a9c-40b4-87a7-2f5cfc6b5e02 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:19.437168 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8ff0a57-1a9c-40b4-87a7-2f5cfc6b5e02 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:19.437851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8ff0a57-1a9c-40b4-87a7-2f5cfc6b5e02 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:19.438362 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8ff0a57-1a9c-40b4-87a7-2f5cfc6b5e02 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:19.438818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8ff0a57-1a9c-40b4-87a7-2f5cfc6b5e02 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:19.625802 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ce93f1d6-7938-414d-a88c-8a16b5a91526 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:19.628897 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8ff0a57-1a9c-40b4-87a7-2f5cfc6b5e02 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:19.634067 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce93f1d6-7938-414d-a88c-8a16b5a91526 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.222535 Sep 17 21:05:19.634631 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 75/158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:19 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:19.637362 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8ff0a57-1a9c-40b4-87a7-2f5cfc6b5e02 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.211537 Sep 17 21:05:19.637918 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 84/159] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:19 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:20.111863 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bce52d21-01aa-4cdf-ab74-598510d8a017 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:20.112466 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bce52d21-01aa-4cdf-ab74-598510d8a017 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:20.118721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7f6dc44-6577-4cdd-8999-37ba101c14d3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:20.119066 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bce52d21-01aa-4cdf-ab74-598510d8a017 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.119335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e7f6dc44-6577-4cdd-8999-37ba101c14d3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:20.119552 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bce52d21-01aa-4cdf-ab74-598510d8a017 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.119979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bce52d21-01aa-4cdf-ab74-598510d8a017 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:20.120667 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bce52d21-01aa-4cdf-ab74-598510d8a017 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.121143 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bce52d21-01aa-4cdf-ab74-598510d8a017 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.121561 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bce52d21-01aa-4cdf-ab74-598510d8a017 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:20.125199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7f6dc44-6577-4cdd-8999-37ba101c14d3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.125682 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7f6dc44-6577-4cdd-8999-37ba101c14d3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.126118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7f6dc44-6577-4cdd-8999-37ba101c14d3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:20.126808 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7f6dc44-6577-4cdd-8999-37ba101c14d3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.127260 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7f6dc44-6577-4cdd-8999-37ba101c14d3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.127679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7f6dc44-6577-4cdd-8999-37ba101c14d3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:20.318800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bce52d21-01aa-4cdf-ab74-598510d8a017 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:20.327089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e7f6dc44-6577-4cdd-8999-37ba101c14d3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:20.329228 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bce52d21-01aa-4cdf-ab74-598510d8a017 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.221040 Sep 17 21:05:20.329998 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 76/160] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:20 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:20.343721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e7f6dc44-6577-4cdd-8999-37ba101c14d3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.229671 Sep 17 21:05:20.344607 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 85/161] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:20 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:20.662745 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3e84cd1-ac16-474e-90f3-890c6578e84e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:20.663362 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d3e84cd1-ac16-474e-90f3-890c6578e84e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:20.670896 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3e84cd1-ac16-474e-90f3-890c6578e84e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.671351 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3e84cd1-ac16-474e-90f3-890c6578e84e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.671789 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3e84cd1-ac16-474e-90f3-890c6578e84e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:20.672490 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3e84cd1-ac16-474e-90f3-890c6578e84e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.672985 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3e84cd1-ac16-474e-90f3-890c6578e84e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.673412 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3e84cd1-ac16-474e-90f3-890c6578e84e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:20.687033 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e08f8591-0560-48cd-bb3d-0c6c7cde4a6f req-8a03afe9-d6c0-49fc-a910-c2d4f2e92c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d0d277-2981-45b9-88e1-1d9dd5aaaff5", "name": "network-vif-plugged", "status": "completed", "tag": "060a7e1b-7fa9-476f-b5fa-fbf114cbea0a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:20.697045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e08f8591-0560-48cd-bb3d-0c6c7cde4a6f req-8a03afe9-d6c0-49fc-a910-c2d4f2e92c11 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.697527 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e08f8591-0560-48cd-bb3d-0c6c7cde4a6f req-8a03afe9-d6c0-49fc-a910-c2d4f2e92c11 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.697960 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e08f8591-0560-48cd-bb3d-0c6c7cde4a6f req-8a03afe9-d6c0-49fc-a910-c2d4f2e92c11 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:20.709071 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e08f8591-0560-48cd-bb3d-0c6c7cde4a6f req-8a03afe9-d6c0-49fc-a910-c2d4f2e92c11 service nova] Creating event network-vif-plugged:060a7e1b-7fa9-476f-b5fa-fbf114cbea0a for instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 on hv-cinder-82651 Sep 17 21:05:20.719662 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e08f8591-0560-48cd-bb3d-0c6c7cde4a6f req-8a03afe9-d6c0-49fc-a910-c2d4f2e92c11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094574 Sep 17 21:05:20.720339 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 77/162] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:20.725660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-565430ac-94eb-4414-93a0-0749187da49f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:20.726350 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-565430ac-94eb-4414-93a0-0749187da49f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:20.733343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-565430ac-94eb-4414-93a0-0749187da49f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.733832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-565430ac-94eb-4414-93a0-0749187da49f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.734272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-565430ac-94eb-4414-93a0-0749187da49f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:20.734971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-565430ac-94eb-4414-93a0-0749187da49f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.735429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-565430ac-94eb-4414-93a0-0749187da49f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.735858 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-565430ac-94eb-4414-93a0-0749187da49f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:20.841481 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d3e84cd1-ac16-474e-90f3-890c6578e84e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:20.849773 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3e84cd1-ac16-474e-90f3-890c6578e84e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.195947 Sep 17 21:05:20.855157 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 86/163] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:20 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:20.890496 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-565430ac-94eb-4414-93a0-0749187da49f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:20.898079 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-565430ac-94eb-4414-93a0-0749187da49f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.176521 Sep 17 21:05:20.899230 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 78/164] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:20 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:21.352703 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6b0b0823-c528-4733-bc4a-81ffbaacaa3c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:21.353341 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6b0b0823-c528-4733-bc4a-81ffbaacaa3c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:21.359341 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b0b0823-c528-4733-bc4a-81ffbaacaa3c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:21.359822 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b0b0823-c528-4733-bc4a-81ffbaacaa3c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:21.360303 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b0b0823-c528-4733-bc4a-81ffbaacaa3c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:21.361001 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b0b0823-c528-4733-bc4a-81ffbaacaa3c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:21.361456 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b0b0823-c528-4733-bc4a-81ffbaacaa3c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:21.361916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b0b0823-c528-4733-bc4a-81ffbaacaa3c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:21.366734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc2f9e69-1f53-40c6-8889-272c1a5626ed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:21.367872 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bc2f9e69-1f53-40c6-8889-272c1a5626ed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:21.374015 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc2f9e69-1f53-40c6-8889-272c1a5626ed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:21.374494 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc2f9e69-1f53-40c6-8889-272c1a5626ed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:21.374927 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc2f9e69-1f53-40c6-8889-272c1a5626ed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:21.376222 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc2f9e69-1f53-40c6-8889-272c1a5626ed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:21.376690 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc2f9e69-1f53-40c6-8889-272c1a5626ed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:21.377128 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc2f9e69-1f53-40c6-8889-272c1a5626ed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:21.555200 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6b0b0823-c528-4733-bc4a-81ffbaacaa3c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:21.565497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6b0b0823-c528-4733-bc4a-81ffbaacaa3c tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.216882 Sep 17 21:05:21.566319 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 87/165] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:21 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:21.571318 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bc2f9e69-1f53-40c6-8889-272c1a5626ed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:21.579534 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bc2f9e69-1f53-40c6-8889-272c1a5626ed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.216574 Sep 17 21:05:21.580429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 79/166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:21 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:21.873732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-01498a15-fa96-4b84-9b4e-5443698e92e4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:21.874257 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-01498a15-fa96-4b84-9b4e-5443698e92e4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:21.876091 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=90 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:21.881995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01498a15-fa96-4b84-9b4e-5443698e92e4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:21.882495 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01498a15-fa96-4b84-9b4e-5443698e92e4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:21.883666 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01498a15-fa96-4b84-9b4e-5443698e92e4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:21.884933 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01498a15-fa96-4b84-9b4e-5443698e92e4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:21.885431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01498a15-fa96-4b84-9b4e-5443698e92e4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:21.885859 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01498a15-fa96-4b84-9b4e-5443698e92e4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:21.931205 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e9db2fa-5fef-4e80-9e3e-bab1cab6d55a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:21.931812 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e9db2fa-5fef-4e80-9e3e-bab1cab6d55a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:21.937938 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e9db2fa-5fef-4e80-9e3e-bab1cab6d55a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:21.938422 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e9db2fa-5fef-4e80-9e3e-bab1cab6d55a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:21.938852 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e9db2fa-5fef-4e80-9e3e-bab1cab6d55a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:21.939650 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e9db2fa-5fef-4e80-9e3e-bab1cab6d55a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:21.940106 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e9db2fa-5fef-4e80-9e3e-bab1cab6d55a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:21.940563 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e9db2fa-5fef-4e80-9e3e-bab1cab6d55a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:22.072230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-01498a15-fa96-4b84-9b4e-5443698e92e4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:22.080076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-01498a15-fa96-4b84-9b4e-5443698e92e4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.210529 Sep 17 21:05:22.080635 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 88/167] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:21 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:22.111064 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2e9db2fa-5fef-4e80-9e3e-bab1cab6d55a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:22.123289 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e9db2fa-5fef-4e80-9e3e-bab1cab6d55a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.205752 Sep 17 21:05:22.123997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 80/168] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:21 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:22.588907 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49c4b734-45af-4117-9282-1dd6428b07fe tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:22.589509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49c4b734-45af-4117-9282-1dd6428b07fe tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:22.595390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c4b734-45af-4117-9282-1dd6428b07fe tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:22.595861 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c4b734-45af-4117-9282-1dd6428b07fe tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:22.596286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c4b734-45af-4117-9282-1dd6428b07fe tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:22.596991 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c4b734-45af-4117-9282-1dd6428b07fe tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:22.597440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c4b734-45af-4117-9282-1dd6428b07fe tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:22.597854 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c4b734-45af-4117-9282-1dd6428b07fe tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:22.605117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-914b2b68-7a9e-4ba7-9757-a093dd923a96 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:22.605726 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-914b2b68-7a9e-4ba7-9757-a093dd923a96 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:22.612112 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-914b2b68-7a9e-4ba7-9757-a093dd923a96 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:22.612216 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-914b2b68-7a9e-4ba7-9757-a093dd923a96 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:22.612766 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-914b2b68-7a9e-4ba7-9757-a093dd923a96 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:22.613469 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-914b2b68-7a9e-4ba7-9757-a093dd923a96 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:22.613924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-914b2b68-7a9e-4ba7-9757-a093dd923a96 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:22.614347 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-914b2b68-7a9e-4ba7-9757-a093dd923a96 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:22.798717 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-49c4b734-45af-4117-9282-1dd6428b07fe tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:22.802778 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-914b2b68-7a9e-4ba7-9757-a093dd923a96 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:22.806511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49c4b734-45af-4117-9282-1dd6428b07fe tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.221461 Sep 17 21:05:22.807085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 89/169] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:22 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:22.810318 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-914b2b68-7a9e-4ba7-9757-a093dd923a96 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.209674 Sep 17 21:05:22.810862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 81/170] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:22 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:23.104333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f2181af-7d31-4ed9-8024-8febebf73d72 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:23.104945 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f2181af-7d31-4ed9-8024-8febebf73d72 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:23.110811 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f2181af-7d31-4ed9-8024-8febebf73d72 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:23.111288 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f2181af-7d31-4ed9-8024-8febebf73d72 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:23.111716 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f2181af-7d31-4ed9-8024-8febebf73d72 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:23.112392 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f2181af-7d31-4ed9-8024-8febebf73d72 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:23.112864 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f2181af-7d31-4ed9-8024-8febebf73d72 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:23.113281 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f2181af-7d31-4ed9-8024-8febebf73d72 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:23.146691 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60f2925a-4ab2-44ba-af70-a7c2c215aa1e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:23.147397 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-60f2925a-4ab2-44ba-af70-a7c2c215aa1e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:23.154091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60f2925a-4ab2-44ba-af70-a7c2c215aa1e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:23.154655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60f2925a-4ab2-44ba-af70-a7c2c215aa1e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:23.155163 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60f2925a-4ab2-44ba-af70-a7c2c215aa1e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:23.155867 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60f2925a-4ab2-44ba-af70-a7c2c215aa1e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:23.156324 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60f2925a-4ab2-44ba-af70-a7c2c215aa1e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:23.156782 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60f2925a-4ab2-44ba-af70-a7c2c215aa1e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:23.299290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f2181af-7d31-4ed9-8024-8febebf73d72 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:23.303175 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:23.308934 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f2181af-7d31-4ed9-8024-8febebf73d72 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.209098 Sep 17 21:05:23.309505 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 90/171] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:23 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:23.329850 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-60f2925a-4ab2-44ba-af70-a7c2c215aa1e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:23.338001 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60f2925a-4ab2-44ba-af70-a7c2c215aa1e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.195140 Sep 17 21:05:23.338557 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 82/172] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:23 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:23.831551 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8163564b-85e5-43a2-9288-156f03fb4721 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:23.832155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8163564b-85e5-43a2-9288-156f03fb4721 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:23.833901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0fa84358-4f55-453f-874d-d78d062beef9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:23.834509 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0fa84358-4f55-453f-874d-d78d062beef9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:23.838383 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8163564b-85e5-43a2-9288-156f03fb4721 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:23.838858 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8163564b-85e5-43a2-9288-156f03fb4721 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:23.839284 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8163564b-85e5-43a2-9288-156f03fb4721 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:23.839966 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8163564b-85e5-43a2-9288-156f03fb4721 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:23.840412 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8163564b-85e5-43a2-9288-156f03fb4721 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:23.840518 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fa84358-4f55-453f-874d-d78d062beef9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:23.840862 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8163564b-85e5-43a2-9288-156f03fb4721 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:23.841004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fa84358-4f55-453f-874d-d78d062beef9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:23.841436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fa84358-4f55-453f-874d-d78d062beef9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:23.842120 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fa84358-4f55-453f-874d-d78d062beef9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:23.842573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fa84358-4f55-453f-874d-d78d062beef9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:23.843011 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fa84358-4f55-453f-874d-d78d062beef9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:24.028041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0fa84358-4f55-453f-874d-d78d062beef9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:24.034826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8163564b-85e5-43a2-9288-156f03fb4721 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:24.035896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0fa84358-4f55-453f-874d-d78d062beef9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.205841 Sep 17 21:05:24.036534 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 83/173] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:23 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:24.044334 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8163564b-85e5-43a2-9288-156f03fb4721 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.216470 Sep 17 21:05:24.045448 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 91/174] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:23 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:24.332740 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-150b421b-6a93-43a9-a9d9-cd47b1b1ee1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:24.333343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-150b421b-6a93-43a9-a9d9-cd47b1b1ee1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:24.340002 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-150b421b-6a93-43a9-a9d9-cd47b1b1ee1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:24.340491 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-150b421b-6a93-43a9-a9d9-cd47b1b1ee1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:24.340967 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-150b421b-6a93-43a9-a9d9-cd47b1b1ee1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:24.341667 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-150b421b-6a93-43a9-a9d9-cd47b1b1ee1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:24.342126 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-150b421b-6a93-43a9-a9d9-cd47b1b1ee1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:24.342554 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-150b421b-6a93-43a9-a9d9-cd47b1b1ee1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:24.346705 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:24.360241 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e9c104f3-7350-49c5-8d59-477469544515 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:24.360883 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e9c104f3-7350-49c5-8d59-477469544515 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:24.366683 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c104f3-7350-49c5-8d59-477469544515 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:24.367233 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c104f3-7350-49c5-8d59-477469544515 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:24.367700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c104f3-7350-49c5-8d59-477469544515 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:24.368385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c104f3-7350-49c5-8d59-477469544515 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:24.368878 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c104f3-7350-49c5-8d59-477469544515 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:24.369300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c104f3-7350-49c5-8d59-477469544515 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:24.560505 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-150b421b-6a93-43a9-a9d9-cd47b1b1ee1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:24.567134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e9c104f3-7350-49c5-8d59-477469544515 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:24.568286 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-150b421b-6a93-43a9-a9d9-cd47b1b1ee1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.239307 Sep 17 21:05:24.568881 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 84/175] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:24 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:24.575390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e9c104f3-7350-49c5-8d59-477469544515 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.218935 Sep 17 21:05:24.575950 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 92/176] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:24 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:25.059632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a2c114e-6cea-42af-a608-10da6973c222 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:25.060240 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a2c114e-6cea-42af-a608-10da6973c222 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:25.066269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a2c114e-6cea-42af-a608-10da6973c222 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:25.066747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a2c114e-6cea-42af-a608-10da6973c222 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:25.066969 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76434421-36a8-4d98-9fd0-ac0be0538218 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:25.067179 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a2c114e-6cea-42af-a608-10da6973c222 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:25.067571 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76434421-36a8-4d98-9fd0-ac0be0538218 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:25.067872 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a2c114e-6cea-42af-a608-10da6973c222 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:25.068326 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a2c114e-6cea-42af-a608-10da6973c222 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:25.068779 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a2c114e-6cea-42af-a608-10da6973c222 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:25.074330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76434421-36a8-4d98-9fd0-ac0be0538218 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:25.074810 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76434421-36a8-4d98-9fd0-ac0be0538218 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:25.075234 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76434421-36a8-4d98-9fd0-ac0be0538218 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:25.075916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76434421-36a8-4d98-9fd0-ac0be0538218 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:25.076361 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76434421-36a8-4d98-9fd0-ac0be0538218 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:25.076805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76434421-36a8-4d98-9fd0-ac0be0538218 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:25.259759 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a2c114e-6cea-42af-a608-10da6973c222 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:25.263830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-76434421-36a8-4d98-9fd0-ac0be0538218 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:25.267560 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a2c114e-6cea-42af-a608-10da6973c222 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.211801 Sep 17 21:05:25.268115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 85/177] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:25 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:25.271628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76434421-36a8-4d98-9fd0-ac0be0538218 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.208390 Sep 17 21:05:25.272216 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 93/178] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:25 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:25.591535 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ab243925-9acf-4eb9-84c8-3f6cf1130ecb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:25.592072 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ab243925-9acf-4eb9-84c8-3f6cf1130ecb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:25.598244 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab243925-9acf-4eb9-84c8-3f6cf1130ecb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:25.598730 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab243925-9acf-4eb9-84c8-3f6cf1130ecb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:25.599121 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ccad50c-1352-416b-a493-8f03ed28f5a3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:25.599623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab243925-9acf-4eb9-84c8-3f6cf1130ecb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:25.599799 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8ccad50c-1352-416b-a493-8f03ed28f5a3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:25.599919 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab243925-9acf-4eb9-84c8-3f6cf1130ecb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:25.600251 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab243925-9acf-4eb9-84c8-3f6cf1130ecb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:25.600666 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab243925-9acf-4eb9-84c8-3f6cf1130ecb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:25.609190 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ccad50c-1352-416b-a493-8f03ed28f5a3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:25.609684 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ccad50c-1352-416b-a493-8f03ed28f5a3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:25.610278 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ccad50c-1352-416b-a493-8f03ed28f5a3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:25.610993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ccad50c-1352-416b-a493-8f03ed28f5a3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:25.611439 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ccad50c-1352-416b-a493-8f03ed28f5a3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:25.611860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ccad50c-1352-416b-a493-8f03ed28f5a3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:25.793005 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ab243925-9acf-4eb9-84c8-3f6cf1130ecb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:25.797213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8ccad50c-1352-416b-a493-8f03ed28f5a3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:25.801516 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ab243925-9acf-4eb9-84c8-3f6cf1130ecb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.213796 Sep 17 21:05:25.802260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 86/179] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:25 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:25.805485 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ccad50c-1352-416b-a493-8f03ed28f5a3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.210098 Sep 17 21:05:25.806188 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 94/180] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:25 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:26.290060 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd20b318-2ba2-4c0e-ae76-aa58ffe5cd32 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:26.290914 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd20b318-2ba2-4c0e-ae76-aa58ffe5cd32 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:26.294999 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-847593f2-c340-4b7f-ae4d-8f8aca0c47b8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:26.295599 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-847593f2-c340-4b7f-ae4d-8f8aca0c47b8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:26.296963 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd20b318-2ba2-4c0e-ae76-aa58ffe5cd32 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:26.297435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd20b318-2ba2-4c0e-ae76-aa58ffe5cd32 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:26.297862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd20b318-2ba2-4c0e-ae76-aa58ffe5cd32 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:26.298541 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd20b318-2ba2-4c0e-ae76-aa58ffe5cd32 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:26.298987 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd20b318-2ba2-4c0e-ae76-aa58ffe5cd32 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:26.299403 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd20b318-2ba2-4c0e-ae76-aa58ffe5cd32 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:26.301416 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-847593f2-c340-4b7f-ae4d-8f8aca0c47b8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:26.301889 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-847593f2-c340-4b7f-ae4d-8f8aca0c47b8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:26.302316 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-847593f2-c340-4b7f-ae4d-8f8aca0c47b8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:26.302995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-847593f2-c340-4b7f-ae4d-8f8aca0c47b8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:26.303442 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-847593f2-c340-4b7f-ae4d-8f8aca0c47b8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:26.303860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-847593f2-c340-4b7f-ae4d-8f8aca0c47b8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:26.494604 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd20b318-2ba2-4c0e-ae76-aa58ffe5cd32 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:26.502427 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd20b318-2ba2-4c0e-ae76-aa58ffe5cd32 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.216149 Sep 17 21:05:26.502998 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 87/181] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:26 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:26.510496 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-847593f2-c340-4b7f-ae4d-8f8aca0c47b8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:26.518030 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-847593f2-c340-4b7f-ae4d-8f8aca0c47b8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.226761 Sep 17 21:05:26.518574 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 95/182] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:26 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:26.824380 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c8e82e0f-b40c-4313-8ac4-e02bf6aebba3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:26.825050 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c8e82e0f-b40c-4313-8ac4-e02bf6aebba3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:26.827687 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-487c7b83-14a1-4b22-9170-773824652e1a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:26.828297 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-487c7b83-14a1-4b22-9170-773824652e1a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:26.831013 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8e82e0f-b40c-4313-8ac4-e02bf6aebba3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:26.831497 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8e82e0f-b40c-4313-8ac4-e02bf6aebba3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:26.831938 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8e82e0f-b40c-4313-8ac4-e02bf6aebba3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:26.832630 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8e82e0f-b40c-4313-8ac4-e02bf6aebba3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:26.833106 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8e82e0f-b40c-4313-8ac4-e02bf6aebba3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:26.833529 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8e82e0f-b40c-4313-8ac4-e02bf6aebba3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:26.834072 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-487c7b83-14a1-4b22-9170-773824652e1a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:26.834550 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-487c7b83-14a1-4b22-9170-773824652e1a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:26.834985 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-487c7b83-14a1-4b22-9170-773824652e1a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:26.835815 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-487c7b83-14a1-4b22-9170-773824652e1a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:26.836282 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-487c7b83-14a1-4b22-9170-773824652e1a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:26.836753 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-487c7b83-14a1-4b22-9170-773824652e1a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:27.023207 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-487c7b83-14a1-4b22-9170-773824652e1a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:27.030944 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8e82e0f-b40c-4313-8ac4-e02bf6aebba3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:27.031272 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-487c7b83-14a1-4b22-9170-773824652e1a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.207371 Sep 17 21:05:27.031842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 96/183] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:26 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:27.039606 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c8e82e0f-b40c-4313-8ac4-e02bf6aebba3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.219477 Sep 17 21:05:27.040174 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 88/184] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:26 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:27.526765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bde39e92-c317-4fe1-8be2-c0b49823659c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:27.527378 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bde39e92-c317-4fe1-8be2-c0b49823659c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:27.533374 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bde39e92-c317-4fe1-8be2-c0b49823659c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:27.533876 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bde39e92-c317-4fe1-8be2-c0b49823659c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:27.534318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bde39e92-c317-4fe1-8be2-c0b49823659c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:27.535011 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bde39e92-c317-4fe1-8be2-c0b49823659c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:27.535493 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bde39e92-c317-4fe1-8be2-c0b49823659c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:27.535918 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bde39e92-c317-4fe1-8be2-c0b49823659c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:27.541549 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e3079ae4-96a5-43d2-9cfa-4102c4e6fdc2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:27.542209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e3079ae4-96a5-43d2-9cfa-4102c4e6fdc2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:27.548123 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3079ae4-96a5-43d2-9cfa-4102c4e6fdc2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:27.548601 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3079ae4-96a5-43d2-9cfa-4102c4e6fdc2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:27.549070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3079ae4-96a5-43d2-9cfa-4102c4e6fdc2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:27.549752 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3079ae4-96a5-43d2-9cfa-4102c4e6fdc2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:27.550196 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3079ae4-96a5-43d2-9cfa-4102c4e6fdc2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:27.550640 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3079ae4-96a5-43d2-9cfa-4102c4e6fdc2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:27.751177 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bde39e92-c317-4fe1-8be2-c0b49823659c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:27.755046 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e3079ae4-96a5-43d2-9cfa-4102c4e6fdc2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:27.759597 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bde39e92-c317-4fe1-8be2-c0b49823659c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.237783 Sep 17 21:05:27.764291 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e3079ae4-96a5-43d2-9cfa-4102c4e6fdc2 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.226940 Sep 17 21:05:27.764939 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 89/185] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:27 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:27.766455 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 97/186] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:27 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:28.058530 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-59c361e7-f0d5-4b6a-8a88-89af5588d90a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:28.059166 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-59c361e7-f0d5-4b6a-8a88-89af5588d90a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:28.063864 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b46c5fe-a7d6-445c-8536-cda4b389e7c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:28.064489 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8b46c5fe-a7d6-445c-8536-cda4b389e7c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:28.065341 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59c361e7-f0d5-4b6a-8a88-89af5588d90a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:28.065822 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59c361e7-f0d5-4b6a-8a88-89af5588d90a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:28.066313 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59c361e7-f0d5-4b6a-8a88-89af5588d90a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:28.067056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59c361e7-f0d5-4b6a-8a88-89af5588d90a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:28.067509 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59c361e7-f0d5-4b6a-8a88-89af5588d90a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:28.067928 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59c361e7-f0d5-4b6a-8a88-89af5588d90a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:28.071982 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b46c5fe-a7d6-445c-8536-cda4b389e7c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:28.072555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b46c5fe-a7d6-445c-8536-cda4b389e7c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:28.073026 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b46c5fe-a7d6-445c-8536-cda4b389e7c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:28.073727 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b46c5fe-a7d6-445c-8536-cda4b389e7c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:28.074186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b46c5fe-a7d6-445c-8536-cda4b389e7c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:28.074608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b46c5fe-a7d6-445c-8536-cda4b389e7c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:28.259312 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-59c361e7-f0d5-4b6a-8a88-89af5588d90a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:28.266851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-59c361e7-f0d5-4b6a-8a88-89af5588d90a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.212467 Sep 17 21:05:28.267412 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 90/187] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:28 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:28.271041 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b46c5fe-a7d6-445c-8536-cda4b389e7c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:28.289854 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b46c5fe-a7d6-445c-8536-cda4b389e7c8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.230219 Sep 17 21:05:28.290434 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 98/188] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:28 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:28.787590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5ef42d44-f946-4cc7-ba53-74592bf2f047 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:28.788194 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5ef42d44-f946-4cc7-ba53-74592bf2f047 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:28.788433 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc10c622-2227-4e26-a936-0342b5136860 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:28.789624 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc10c622-2227-4e26-a936-0342b5136860 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:28.794902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ef42d44-f946-4cc7-ba53-74592bf2f047 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:28.795390 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ef42d44-f946-4cc7-ba53-74592bf2f047 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:28.795824 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ef42d44-f946-4cc7-ba53-74592bf2f047 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:28.796239 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc10c622-2227-4e26-a936-0342b5136860 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:28.796518 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ef42d44-f946-4cc7-ba53-74592bf2f047 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:28.796753 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc10c622-2227-4e26-a936-0342b5136860 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:28.796997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ef42d44-f946-4cc7-ba53-74592bf2f047 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:28.797184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc10c622-2227-4e26-a936-0342b5136860 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:28.797415 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ef42d44-f946-4cc7-ba53-74592bf2f047 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:28.797876 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc10c622-2227-4e26-a936-0342b5136860 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:28.798325 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc10c622-2227-4e26-a936-0342b5136860 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:28.798741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc10c622-2227-4e26-a936-0342b5136860 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:29.004192 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5ef42d44-f946-4cc7-ba53-74592bf2f047 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:29.005856 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc10c622-2227-4e26-a936-0342b5136860 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:29.014219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc10c622-2227-4e26-a936-0342b5136860 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.229533 Sep 17 21:05:29.014402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5ef42d44-f946-4cc7-ba53-74592bf2f047 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.230806 Sep 17 21:05:29.015301 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 91/189] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:28 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:29.016211 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 99/190] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:28 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:29.293723 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f51a65cd-90ad-403d-b7ca-9fe1f94eb25a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:29.294256 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f51a65cd-90ad-403d-b7ca-9fe1f94eb25a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:29.300141 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f51a65cd-90ad-403d-b7ca-9fe1f94eb25a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:29.300619 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f51a65cd-90ad-403d-b7ca-9fe1f94eb25a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:29.301077 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f51a65cd-90ad-403d-b7ca-9fe1f94eb25a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:29.301756 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f51a65cd-90ad-403d-b7ca-9fe1f94eb25a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:29.302206 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f51a65cd-90ad-403d-b7ca-9fe1f94eb25a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:29.302626 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f51a65cd-90ad-403d-b7ca-9fe1f94eb25a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:29.311950 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c9c1a5e-dd90-4b82-9291-753196c1c815 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:29.312555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c9c1a5e-dd90-4b82-9291-753196c1c815 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:29.318418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c9c1a5e-dd90-4b82-9291-753196c1c815 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:29.318896 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c9c1a5e-dd90-4b82-9291-753196c1c815 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:29.319322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c9c1a5e-dd90-4b82-9291-753196c1c815 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:29.320183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c9c1a5e-dd90-4b82-9291-753196c1c815 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:29.320838 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c9c1a5e-dd90-4b82-9291-753196c1c815 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:29.321266 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c9c1a5e-dd90-4b82-9291-753196c1c815 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:29.497032 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f51a65cd-90ad-403d-b7ca-9fe1f94eb25a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:29.500820 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c9c1a5e-dd90-4b82-9291-753196c1c815 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:29.504866 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f51a65cd-90ad-403d-b7ca-9fe1f94eb25a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.215148 Sep 17 21:05:29.505427 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 92/191] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:29 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:29.508654 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c9c1a5e-dd90-4b82-9291-753196c1c815 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.200477 Sep 17 21:05:29.509242 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 100/192] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:29 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:30.036468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b5ee0f38-fdca-46bc-8d5d-3bf4b2db1b4e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:30.037100 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b5ee0f38-fdca-46bc-8d5d-3bf4b2db1b4e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:30.038965 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd0225c4-3a6b-4f8d-81d7-c8fc136a3087 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:30.039568 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cd0225c4-3a6b-4f8d-81d7-c8fc136a3087 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:30.043273 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5ee0f38-fdca-46bc-8d5d-3bf4b2db1b4e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:30.043760 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5ee0f38-fdca-46bc-8d5d-3bf4b2db1b4e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:30.044195 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5ee0f38-fdca-46bc-8d5d-3bf4b2db1b4e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:30.044919 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5ee0f38-fdca-46bc-8d5d-3bf4b2db1b4e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:30.045372 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5ee0f38-fdca-46bc-8d5d-3bf4b2db1b4e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:30.045553 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd0225c4-3a6b-4f8d-81d7-c8fc136a3087 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:30.045846 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5ee0f38-fdca-46bc-8d5d-3bf4b2db1b4e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:30.045988 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd0225c4-3a6b-4f8d-81d7-c8fc136a3087 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:30.046412 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd0225c4-3a6b-4f8d-81d7-c8fc136a3087 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:30.047404 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd0225c4-3a6b-4f8d-81d7-c8fc136a3087 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:30.047735 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd0225c4-3a6b-4f8d-81d7-c8fc136a3087 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:30.048186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd0225c4-3a6b-4f8d-81d7-c8fc136a3087 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:30.228509 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b5ee0f38-fdca-46bc-8d5d-3bf4b2db1b4e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:30.235979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b5ee0f38-fdca-46bc-8d5d-3bf4b2db1b4e tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.203228 Sep 17 21:05:30.236534 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 93/193] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:30 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:30.251047 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cd0225c4-3a6b-4f8d-81d7-c8fc136a3087 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:30.259136 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd0225c4-3a6b-4f8d-81d7-c8fc136a3087 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.223819 Sep 17 21:05:30.259685 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 101/194] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:30 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:30.527369 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf735313-e27a-47da-a61b-e295eb283629 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:30.527989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cf735313-e27a-47da-a61b-e295eb283629 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:30.531057 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-789247ea-0f0b-4361-943a-14340415f4f7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:30.531659 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-789247ea-0f0b-4361-943a-14340415f4f7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:30.534235 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf735313-e27a-47da-a61b-e295eb283629 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:30.534721 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf735313-e27a-47da-a61b-e295eb283629 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:30.535154 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf735313-e27a-47da-a61b-e295eb283629 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:30.535913 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf735313-e27a-47da-a61b-e295eb283629 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:30.536371 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf735313-e27a-47da-a61b-e295eb283629 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:30.536824 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf735313-e27a-47da-a61b-e295eb283629 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:30.537372 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-789247ea-0f0b-4361-943a-14340415f4f7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:30.537845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-789247ea-0f0b-4361-943a-14340415f4f7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:30.538271 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-789247ea-0f0b-4361-943a-14340415f4f7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:30.538959 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-789247ea-0f0b-4361-943a-14340415f4f7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:30.539399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-789247ea-0f0b-4361-943a-14340415f4f7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:30.539812 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-789247ea-0f0b-4361-943a-14340415f4f7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:30.730955 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf735313-e27a-47da-a61b-e295eb283629 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:30.738663 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf735313-e27a-47da-a61b-e295eb283629 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.215446 Sep 17 21:05:30.739306 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 94/195] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:30 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:30.743500 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-789247ea-0f0b-4361-943a-14340415f4f7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:30.751790 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-789247ea-0f0b-4361-943a-14340415f4f7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.224463 Sep 17 21:05:30.752430 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 102/196] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:30 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:31.259080 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75baf2fd-5c6d-4a0c-a0a8-777604748a77 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:31.259709 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-75baf2fd-5c6d-4a0c-a0a8-777604748a77 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:31.265517 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75baf2fd-5c6d-4a0c-a0a8-777604748a77 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:31.265991 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75baf2fd-5c6d-4a0c-a0a8-777604748a77 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:31.266417 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75baf2fd-5c6d-4a0c-a0a8-777604748a77 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:31.267111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75baf2fd-5c6d-4a0c-a0a8-777604748a77 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:31.267558 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75baf2fd-5c6d-4a0c-a0a8-777604748a77 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:31.267971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75baf2fd-5c6d-4a0c-a0a8-777604748a77 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:31.281116 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3bb169e-a9d4-4521-8c3e-ea190ea47229 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:31.281721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d3bb169e-a9d4-4521-8c3e-ea190ea47229 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:31.287512 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3bb169e-a9d4-4521-8c3e-ea190ea47229 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:31.287993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3bb169e-a9d4-4521-8c3e-ea190ea47229 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:31.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3bb169e-a9d4-4521-8c3e-ea190ea47229 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:31.289723 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3bb169e-a9d4-4521-8c3e-ea190ea47229 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:31.290182 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3bb169e-a9d4-4521-8c3e-ea190ea47229 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:31.290605 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3bb169e-a9d4-4521-8c3e-ea190ea47229 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:31.465751 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-75baf2fd-5c6d-4a0c-a0a8-777604748a77 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:31.469890 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d3bb169e-a9d4-4521-8c3e-ea190ea47229 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:31.473307 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75baf2fd-5c6d-4a0c-a0a8-777604748a77 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.217976 Sep 17 21:05:31.473873 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 95/197] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:31 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:31.477442 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3bb169e-a9d4-4521-8c3e-ea190ea47229 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.200079 Sep 17 21:05:31.477984 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 103/198] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:31 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:31.762448 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67dfbf0b-2faa-42a8-bb80-98b5e2c6c808 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:31.763094 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-67dfbf0b-2faa-42a8-bb80-98b5e2c6c808 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:31.769713 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67dfbf0b-2faa-42a8-bb80-98b5e2c6c808 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:31.770246 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67dfbf0b-2faa-42a8-bb80-98b5e2c6c808 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:31.770686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67dfbf0b-2faa-42a8-bb80-98b5e2c6c808 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:31.771392 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67dfbf0b-2faa-42a8-bb80-98b5e2c6c808 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:31.771849 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67dfbf0b-2faa-42a8-bb80-98b5e2c6c808 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:31.772274 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67dfbf0b-2faa-42a8-bb80-98b5e2c6c808 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:31.777914 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc438053-033b-4c86-9d4a-a7a68d1d9bcf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:31.777914 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fc438053-033b-4c86-9d4a-a7a68d1d9bcf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:31.783177 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc438053-033b-4c86-9d4a-a7a68d1d9bcf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:31.783804 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc438053-033b-4c86-9d4a-a7a68d1d9bcf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:31.784313 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc438053-033b-4c86-9d4a-a7a68d1d9bcf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:31.785138 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc438053-033b-4c86-9d4a-a7a68d1d9bcf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:31.785598 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc438053-033b-4c86-9d4a-a7a68d1d9bcf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:31.786026 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc438053-033b-4c86-9d4a-a7a68d1d9bcf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:31.971809 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-67dfbf0b-2faa-42a8-bb80-98b5e2c6c808 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:31.976185 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fc438053-033b-4c86-9d4a-a7a68d1d9bcf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:31.980137 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-67dfbf0b-2faa-42a8-bb80-98b5e2c6c808 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.221666 Sep 17 21:05:31.980746 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 96/199] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:31 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:31.984405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc438053-033b-4c86-9d4a-a7a68d1d9bcf tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.212378 Sep 17 21:05:31.984993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 104/200] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:31 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:32.496534 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3aa1a5ed-4034-48ca-8fb1-a2930aa57d54 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:32.497195 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3aa1a5ed-4034-48ca-8fb1-a2930aa57d54 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:32.499670 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a3c4c5b-9c1c-4a5c-a60a-520e46fa10ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:32.500388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1a3c4c5b-9c1c-4a5c-a60a-520e46fa10ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:32.503465 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa1a5ed-4034-48ca-8fb1-a2930aa57d54 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:32.504091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa1a5ed-4034-48ca-8fb1-a2930aa57d54 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:32.504647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa1a5ed-4034-48ca-8fb1-a2930aa57d54 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:32.505520 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa1a5ed-4034-48ca-8fb1-a2930aa57d54 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:32.506084 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa1a5ed-4034-48ca-8fb1-a2930aa57d54 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:32.506508 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa1a5ed-4034-48ca-8fb1-a2930aa57d54 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:32.510098 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a3c4c5b-9c1c-4a5c-a60a-520e46fa10ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:32.510588 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a3c4c5b-9c1c-4a5c-a60a-520e46fa10ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:32.511026 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a3c4c5b-9c1c-4a5c-a60a-520e46fa10ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:32.511781 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a3c4c5b-9c1c-4a5c-a60a-520e46fa10ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:32.512233 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a3c4c5b-9c1c-4a5c-a60a-520e46fa10ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:32.512656 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a3c4c5b-9c1c-4a5c-a60a-520e46fa10ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:32.693876 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a3c4c5b-9c1c-4a5c-a60a-520e46fa10ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:32.701133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3aa1a5ed-4034-48ca-8fb1-a2930aa57d54 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:32.702170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a3c4c5b-9c1c-4a5c-a60a-520e46fa10ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.206839 Sep 17 21:05:32.702822 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 105/201] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:32 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:32.708828 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3aa1a5ed-4034-48ca-8fb1-a2930aa57d54 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.216475 Sep 17 21:05:32.709379 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 97/202] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:32 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:33.005099 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ee4a764-ad38-4790-85a7-20b2b3734366 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:33.006105 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8ee4a764-ad38-4790-85a7-20b2b3734366 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:33.008028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-05ba5a32-3dc4-4b13-8bc1-009a6b90e4d0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:33.008854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-05ba5a32-3dc4-4b13-8bc1-009a6b90e4d0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:33.012733 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ee4a764-ad38-4790-85a7-20b2b3734366 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:33.013225 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ee4a764-ad38-4790-85a7-20b2b3734366 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:33.013659 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ee4a764-ad38-4790-85a7-20b2b3734366 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:33.014346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ee4a764-ad38-4790-85a7-20b2b3734366 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:33.014786 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05ba5a32-3dc4-4b13-8bc1-009a6b90e4d0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:33.014891 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ee4a764-ad38-4790-85a7-20b2b3734366 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:33.015215 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ee4a764-ad38-4790-85a7-20b2b3734366 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:33.015315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05ba5a32-3dc4-4b13-8bc1-009a6b90e4d0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:33.015683 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05ba5a32-3dc4-4b13-8bc1-009a6b90e4d0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:33.016400 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05ba5a32-3dc4-4b13-8bc1-009a6b90e4d0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:33.016886 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05ba5a32-3dc4-4b13-8bc1-009a6b90e4d0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:33.017304 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05ba5a32-3dc4-4b13-8bc1-009a6b90e4d0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:33.386001 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8ee4a764-ad38-4790-85a7-20b2b3734366 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:33.388400 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-05ba5a32-3dc4-4b13-8bc1-009a6b90e4d0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:33.396613 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ee4a764-ad38-4790-85a7-20b2b3734366 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.396458 Sep 17 21:05:33.397226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 106/203] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:32 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:33.398706 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-05ba5a32-3dc4-4b13-8bc1-009a6b90e4d0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.394995 Sep 17 21:05:33.399435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 98/204] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:33 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:33.725059 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad7d0673-6220-4449-883e-7a12751d758b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:33.725669 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ad7d0673-6220-4449-883e-7a12751d758b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:33.731598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1cc57391-2b35-4a50-89a0-83e79e9eb1d6 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:33.732196 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1cc57391-2b35-4a50-89a0-83e79e9eb1d6 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:33.732320 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7d0673-6220-4449-883e-7a12751d758b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:33.732691 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7d0673-6220-4449-883e-7a12751d758b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:33.733201 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7d0673-6220-4449-883e-7a12751d758b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:33.733892 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7d0673-6220-4449-883e-7a12751d758b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:33.734348 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7d0673-6220-4449-883e-7a12751d758b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:33.734767 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7d0673-6220-4449-883e-7a12751d758b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:33.738017 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cc57391-2b35-4a50-89a0-83e79e9eb1d6 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:33.739755 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cc57391-2b35-4a50-89a0-83e79e9eb1d6 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:33.739755 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cc57391-2b35-4a50-89a0-83e79e9eb1d6 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:33.739755 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cc57391-2b35-4a50-89a0-83e79e9eb1d6 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:33.740036 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cc57391-2b35-4a50-89a0-83e79e9eb1d6 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:33.740407 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cc57391-2b35-4a50-89a0-83e79e9eb1d6 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:33.754108 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:33.930018 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ad7d0673-6220-4449-883e-7a12751d758b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:33.946906 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1cc57391-2b35-4a50-89a0-83e79e9eb1d6 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:33.947132 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad7d0673-6220-4449-883e-7a12751d758b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.216835 Sep 17 21:05:33.947132 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 107/205] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:33 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:33.947332 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1cc57391-2b35-4a50-89a0-83e79e9eb1d6 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.217809 Sep 17 21:05:33.947332 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 99/206] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:33 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:34.419978 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec703d7f-ebaa-4660-871b-5c8ea90fcf0b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:34.420737 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec703d7f-ebaa-4660-871b-5c8ea90fcf0b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:34.422678 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6df8b5db-9b57-4584-aab9-a5ce58d5ef31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:34.423392 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6df8b5db-9b57-4584-aab9-a5ce58d5ef31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:34.426951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec703d7f-ebaa-4660-871b-5c8ea90fcf0b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:34.427434 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec703d7f-ebaa-4660-871b-5c8ea90fcf0b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:34.428047 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec703d7f-ebaa-4660-871b-5c8ea90fcf0b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:34.428936 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec703d7f-ebaa-4660-871b-5c8ea90fcf0b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:34.429960 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec703d7f-ebaa-4660-871b-5c8ea90fcf0b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:34.430382 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec703d7f-ebaa-4660-871b-5c8ea90fcf0b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:34.430496 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6df8b5db-9b57-4584-aab9-a5ce58d5ef31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:34.431116 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6df8b5db-9b57-4584-aab9-a5ce58d5ef31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:34.431616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6df8b5db-9b57-4584-aab9-a5ce58d5ef31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:34.432390 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6df8b5db-9b57-4584-aab9-a5ce58d5ef31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:34.433049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6df8b5db-9b57-4584-aab9-a5ce58d5ef31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:34.433636 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6df8b5db-9b57-4584-aab9-a5ce58d5ef31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:34.640666 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6df8b5db-9b57-4584-aab9-a5ce58d5ef31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:34.644086 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:34.644354 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ec703d7f-ebaa-4660-871b-5c8ea90fcf0b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:34.649712 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6df8b5db-9b57-4584-aab9-a5ce58d5ef31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.231920 Sep 17 21:05:34.650477 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 100/207] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:34 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:34.662024 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec703d7f-ebaa-4660-871b-5c8ea90fcf0b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.245983 Sep 17 21:05:34.662658 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 108/208] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:34 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:34.963822 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11b3560c-a214-4b20-9a50-945545d516e9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:34.963822 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-11b3560c-a214-4b20-9a50-945545d516e9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:34.968695 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c495fe76-ec8d-40f4-afb9-e0700bb02f95 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:34.969387 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c495fe76-ec8d-40f4-afb9-e0700bb02f95 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:34.970126 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11b3560c-a214-4b20-9a50-945545d516e9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:34.970721 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11b3560c-a214-4b20-9a50-945545d516e9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:34.971253 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11b3560c-a214-4b20-9a50-945545d516e9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:34.972029 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11b3560c-a214-4b20-9a50-945545d516e9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:34.972557 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11b3560c-a214-4b20-9a50-945545d516e9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:34.973074 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11b3560c-a214-4b20-9a50-945545d516e9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:34.979349 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c495fe76-ec8d-40f4-afb9-e0700bb02f95 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:34.980129 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c495fe76-ec8d-40f4-afb9-e0700bb02f95 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:34.982234 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c495fe76-ec8d-40f4-afb9-e0700bb02f95 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:34.984018 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c495fe76-ec8d-40f4-afb9-e0700bb02f95 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:34.984489 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c495fe76-ec8d-40f4-afb9-e0700bb02f95 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:34.984948 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c495fe76-ec8d-40f4-afb9-e0700bb02f95 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:35.177160 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-11b3560c-a214-4b20-9a50-945545d516e9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:35.187256 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-11b3560c-a214-4b20-9a50-945545d516e9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.229234 Sep 17 21:05:35.191130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c495fe76-ec8d-40f4-afb9-e0700bb02f95 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:35.212703 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 101/209] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:34 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:35.212903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c495fe76-ec8d-40f4-afb9-e0700bb02f95 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.239678 Sep 17 21:05:35.212903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 109/210] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:34 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:35.673952 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5cfc0914-3b03-445d-96a6-d4625f5cde58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:35.678224 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5cfc0914-3b03-445d-96a6-d4625f5cde58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:35.690417 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e82d4550-a9e4-43e6-96f5-4c771cb76d4c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:35.690417 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e82d4550-a9e4-43e6-96f5-4c771cb76d4c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:35.693839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e82d4550-a9e4-43e6-96f5-4c771cb76d4c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:35.694405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e82d4550-a9e4-43e6-96f5-4c771cb76d4c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:35.695234 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e82d4550-a9e4-43e6-96f5-4c771cb76d4c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:35.696085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e82d4550-a9e4-43e6-96f5-4c771cb76d4c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:35.697038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e82d4550-a9e4-43e6-96f5-4c771cb76d4c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:35.697508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e82d4550-a9e4-43e6-96f5-4c771cb76d4c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:35.706581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cfc0914-3b03-445d-96a6-d4625f5cde58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:35.707073 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cfc0914-3b03-445d-96a6-d4625f5cde58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:35.707505 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cfc0914-3b03-445d-96a6-d4625f5cde58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:35.708204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cfc0914-3b03-445d-96a6-d4625f5cde58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:35.708652 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cfc0914-3b03-445d-96a6-d4625f5cde58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:35.709095 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cfc0914-3b03-445d-96a6-d4625f5cde58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:35.933465 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cfc0914-3b03-445d-96a6-d4625f5cde58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:35.943336 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5cfc0914-3b03-445d-96a6-d4625f5cde58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.273068 Sep 17 21:05:35.943989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 102/211] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:35 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:35.950180 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e82d4550-a9e4-43e6-96f5-4c771cb76d4c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:35.958717 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e82d4550-a9e4-43e6-96f5-4c771cb76d4c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.276572 Sep 17 21:05:35.959492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 110/212] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:35 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:36.227467 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a6153718-4980-40b4-a79c-2e1297f7c811 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:36.228114 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a6153718-4980-40b4-a79c-2e1297f7c811 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:36.229477 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a624cf8-5c30-4af5-bf66-69966fc22c24 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:36.230369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a624cf8-5c30-4af5-bf66-69966fc22c24 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:36.235046 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6153718-4980-40b4-a79c-2e1297f7c811 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:36.235741 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6153718-4980-40b4-a79c-2e1297f7c811 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:36.236473 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6153718-4980-40b4-a79c-2e1297f7c811 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:36.236894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a624cf8-5c30-4af5-bf66-69966fc22c24 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:36.237492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6153718-4980-40b4-a79c-2e1297f7c811 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:36.237611 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a624cf8-5c30-4af5-bf66-69966fc22c24 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:36.237922 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a624cf8-5c30-4af5-bf66-69966fc22c24 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:36.238067 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6153718-4980-40b4-a79c-2e1297f7c811 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:36.238611 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a624cf8-5c30-4af5-bf66-69966fc22c24 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:36.238736 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6153718-4980-40b4-a79c-2e1297f7c811 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:36.239199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a624cf8-5c30-4af5-bf66-69966fc22c24 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:36.239623 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a624cf8-5c30-4af5-bf66-69966fc22c24 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:36.447592 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a6153718-4980-40b4-a79c-2e1297f7c811 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:36.459353 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a6153718-4980-40b4-a79c-2e1297f7c811 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.236473 Sep 17 21:05:36.460092 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 103/213] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:36 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:36.474351 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a624cf8-5c30-4af5-bf66-69966fc22c24 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:36.490006 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a624cf8-5c30-4af5-bf66-69966fc22c24 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.264871 Sep 17 21:05:36.500608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 111/214] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:36 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:36.906405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-809c3baa-d68a-4965-95e0-5210000f24b6 req-163b737b-f290-4382-aab1-8301523f9198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19898312-d61b-457d-8217-d6c8e2ad2dbc", "name": "network-vif-plugged", "status": "completed", "tag": "b2f701f8-a237-4a6e-9896-f63fd717b63e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:36.918589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-809c3baa-d68a-4965-95e0-5210000f24b6 req-163b737b-f290-4382-aab1-8301523f9198 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:36.919315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-809c3baa-d68a-4965-95e0-5210000f24b6 req-163b737b-f290-4382-aab1-8301523f9198 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:36.920011 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-809c3baa-d68a-4965-95e0-5210000f24b6 req-163b737b-f290-4382-aab1-8301523f9198 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:36.959114 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-809c3baa-d68a-4965-95e0-5210000f24b6 req-163b737b-f290-4382-aab1-8301523f9198 service nova] Creating event network-vif-plugged:b2f701f8-a237-4a6e-9896-f63fd717b63e for instance 19898312-d61b-457d-8217-d6c8e2ad2dbc on hv-cinder-82651 Sep 17 21:05:36.967717 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-14b4cbd5-6484-40d9-a7c7-8728e3bc70ae tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:36.969551 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-14b4cbd5-6484-40d9-a7c7-8728e3bc70ae tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:36.999861 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14b4cbd5-6484-40d9-a7c7-8728e3bc70ae tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:37.003493 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14b4cbd5-6484-40d9-a7c7-8728e3bc70ae tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:37.007841 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14b4cbd5-6484-40d9-a7c7-8728e3bc70ae tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:37.008861 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14b4cbd5-6484-40d9-a7c7-8728e3bc70ae tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:37.009277 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-809c3baa-d68a-4965-95e0-5210000f24b6 req-163b737b-f290-4382-aab1-8301523f9198 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104385 Sep 17 21:05:37.011695 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14b4cbd5-6484-40d9-a7c7-8728e3bc70ae tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:37.015465 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14b4cbd5-6484-40d9-a7c7-8728e3bc70ae tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:37.015653 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 104/215] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:37.056097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7788bb3-608a-47ed-a08c-70317cf1527d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:37.062997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7788bb3-608a-47ed-a08c-70317cf1527d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:37.083282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7788bb3-608a-47ed-a08c-70317cf1527d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:37.084078 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7788bb3-608a-47ed-a08c-70317cf1527d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:37.084662 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7788bb3-608a-47ed-a08c-70317cf1527d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:37.086231 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7788bb3-608a-47ed-a08c-70317cf1527d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:37.088798 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7788bb3-608a-47ed-a08c-70317cf1527d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:37.091140 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7788bb3-608a-47ed-a08c-70317cf1527d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:37.548432 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7788bb3-608a-47ed-a08c-70317cf1527d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:37.552029 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-14b4cbd5-6484-40d9-a7c7-8728e3bc70ae tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:37.561821 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-14b4cbd5-6484-40d9-a7c7-8728e3bc70ae tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.597977 Sep 17 21:05:37.562666 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 112/216] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:36 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:37.566045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7788bb3-608a-47ed-a08c-70317cf1527d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.548984 Sep 17 21:05:37.582480 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 105/217] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:37 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:37.590236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a468c3fa-3c5a-4714-80fe-d00e773c7bb5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:37.592256 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a468c3fa-3c5a-4714-80fe-d00e773c7bb5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:37.593266 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-77ecc927-c76f-48e9-8247-5716b9e948ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:37.594163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-77ecc927-c76f-48e9-8247-5716b9e948ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:37.602175 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77ecc927-c76f-48e9-8247-5716b9e948ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:37.602877 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77ecc927-c76f-48e9-8247-5716b9e948ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:37.603541 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77ecc927-c76f-48e9-8247-5716b9e948ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:37.604399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77ecc927-c76f-48e9-8247-5716b9e948ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:37.605030 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77ecc927-c76f-48e9-8247-5716b9e948ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:37.605661 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77ecc927-c76f-48e9-8247-5716b9e948ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:37.608581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a468c3fa-3c5a-4714-80fe-d00e773c7bb5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:37.609120 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a468c3fa-3c5a-4714-80fe-d00e773c7bb5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:37.611141 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a468c3fa-3c5a-4714-80fe-d00e773c7bb5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:37.612558 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a468c3fa-3c5a-4714-80fe-d00e773c7bb5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:37.614419 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a468c3fa-3c5a-4714-80fe-d00e773c7bb5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:37.616787 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a468c3fa-3c5a-4714-80fe-d00e773c7bb5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:37.828608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-77ecc927-c76f-48e9-8247-5716b9e948ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:37.836343 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-77ecc927-c76f-48e9-8247-5716b9e948ba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.269289 Sep 17 21:05:37.837079 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 113/218] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:37 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:37.842916 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a468c3fa-3c5a-4714-80fe-d00e773c7bb5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:37.850377 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a468c3fa-3c5a-4714-80fe-d00e773c7bb5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.266316 Sep 17 21:05:37.851262 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 106/219] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:37 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:38.588005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc15dc45-1dcc-433d-a33d-abeafbb09336 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:38.588617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fc15dc45-1dcc-433d-a33d-abeafbb09336 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:38.595065 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc15dc45-1dcc-433d-a33d-abeafbb09336 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:38.595554 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc15dc45-1dcc-433d-a33d-abeafbb09336 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:38.595976 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc15dc45-1dcc-433d-a33d-abeafbb09336 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:38.596692 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc15dc45-1dcc-433d-a33d-abeafbb09336 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:38.597152 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc15dc45-1dcc-433d-a33d-abeafbb09336 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:38.597574 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc15dc45-1dcc-433d-a33d-abeafbb09336 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:38.598986 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7c427e1-4a25-4ed5-aad5-3b13cd2e4172 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:38.599593 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f7c427e1-4a25-4ed5-aad5-3b13cd2e4172 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:38.612905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c427e1-4a25-4ed5-aad5-3b13cd2e4172 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:38.612905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c427e1-4a25-4ed5-aad5-3b13cd2e4172 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:38.612905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c427e1-4a25-4ed5-aad5-3b13cd2e4172 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:38.612905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c427e1-4a25-4ed5-aad5-3b13cd2e4172 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:38.613266 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c427e1-4a25-4ed5-aad5-3b13cd2e4172 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:38.613266 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c427e1-4a25-4ed5-aad5-3b13cd2e4172 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:38.827507 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7c427e1-4a25-4ed5-aad5-3b13cd2e4172 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:38.831851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fc15dc45-1dcc-433d-a33d-abeafbb09336 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:38.838478 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7c427e1-4a25-4ed5-aad5-3b13cd2e4172 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.244126 Sep 17 21:05:38.839774 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 107/220] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:38 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:38.840003 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc15dc45-1dcc-433d-a33d-abeafbb09336 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.256588 Sep 17 21:05:38.840763 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 114/221] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:38 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:38.860999 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d728be0-681b-465e-bef4-ea08e7498d51 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:38.861606 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d728be0-681b-465e-bef4-ea08e7498d51 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:38.867970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d728be0-681b-465e-bef4-ea08e7498d51 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:38.868454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d728be0-681b-465e-bef4-ea08e7498d51 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:38.868990 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d728be0-681b-465e-bef4-ea08e7498d51 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:38.869915 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d728be0-681b-465e-bef4-ea08e7498d51 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:38.870517 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d728be0-681b-465e-bef4-ea08e7498d51 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:38.871110 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d728be0-681b-465e-bef4-ea08e7498d51 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:38.874083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25861309-41db-4f31-935f-a2b6e58f7174 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:38.874690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-25861309-41db-4f31-935f-a2b6e58f7174 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:38.881170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25861309-41db-4f31-935f-a2b6e58f7174 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:38.881652 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25861309-41db-4f31-935f-a2b6e58f7174 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:38.882117 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25861309-41db-4f31-935f-a2b6e58f7174 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:38.882900 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25861309-41db-4f31-935f-a2b6e58f7174 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:38.883353 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25861309-41db-4f31-935f-a2b6e58f7174 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:38.883772 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25861309-41db-4f31-935f-a2b6e58f7174 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:39.074990 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d728be0-681b-465e-bef4-ea08e7498d51 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:39.083116 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-25861309-41db-4f31-935f-a2b6e58f7174 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:39.083722 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d728be0-681b-465e-bef4-ea08e7498d51 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.226374 Sep 17 21:05:39.084450 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 108/222] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:38 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:39.091909 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-25861309-41db-4f31-935f-a2b6e58f7174 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.221740 Sep 17 21:05:39.105893 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 115/223] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:38 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:39.863162 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-725d0616-bfdf-456e-be4f-d350b80c1e38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:39.863687 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-571b8b84-9cc9-4f68-a757-a884b3668a5e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:39.864018 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-725d0616-bfdf-456e-be4f-d350b80c1e38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:39.864103 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-571b8b84-9cc9-4f68-a757-a884b3668a5e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:39.870410 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-725d0616-bfdf-456e-be4f-d350b80c1e38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:39.870706 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-571b8b84-9cc9-4f68-a757-a884b3668a5e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:39.870883 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-725d0616-bfdf-456e-be4f-d350b80c1e38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:39.871194 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-571b8b84-9cc9-4f68-a757-a884b3668a5e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:39.871434 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-725d0616-bfdf-456e-be4f-d350b80c1e38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:39.871610 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-571b8b84-9cc9-4f68-a757-a884b3668a5e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:39.872117 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-725d0616-bfdf-456e-be4f-d350b80c1e38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:39.872287 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-571b8b84-9cc9-4f68-a757-a884b3668a5e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:39.872658 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-725d0616-bfdf-456e-be4f-d350b80c1e38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:39.872949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-571b8b84-9cc9-4f68-a757-a884b3668a5e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:39.873129 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-725d0616-bfdf-456e-be4f-d350b80c1e38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:39.873345 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-571b8b84-9cc9-4f68-a757-a884b3668a5e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:40.067854 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-725d0616-bfdf-456e-be4f-d350b80c1e38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:40.077200 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-725d0616-bfdf-456e-be4f-d350b80c1e38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.217201 Sep 17 21:05:40.077575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 116/224] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:39 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:40.079464 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-571b8b84-9cc9-4f68-a757-a884b3668a5e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:40.088334 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-571b8b84-9cc9-4f68-a757-a884b3668a5e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.228985 Sep 17 21:05:40.089351 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 109/225] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:39 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:40.106300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a8da474d-4f42-411c-9ca0-412c3ddc7649 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:40.106935 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a8da474d-4f42-411c-9ca0-412c3ddc7649 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:40.112929 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8da474d-4f42-411c-9ca0-412c3ddc7649 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:40.113414 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8da474d-4f42-411c-9ca0-412c3ddc7649 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:40.113847 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8da474d-4f42-411c-9ca0-412c3ddc7649 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:40.114544 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8da474d-4f42-411c-9ca0-412c3ddc7649 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:40.115010 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8da474d-4f42-411c-9ca0-412c3ddc7649 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:40.115421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8da474d-4f42-411c-9ca0-412c3ddc7649 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:40.117492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3235067e-0e8f-49b3-9e06-25e3a842732f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:40.118180 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3235067e-0e8f-49b3-9e06-25e3a842732f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:40.123912 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3235067e-0e8f-49b3-9e06-25e3a842732f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:40.124389 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3235067e-0e8f-49b3-9e06-25e3a842732f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:40.124881 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3235067e-0e8f-49b3-9e06-25e3a842732f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:40.125561 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3235067e-0e8f-49b3-9e06-25e3a842732f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:40.126010 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3235067e-0e8f-49b3-9e06-25e3a842732f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:40.126425 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3235067e-0e8f-49b3-9e06-25e3a842732f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:40.307091 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a8da474d-4f42-411c-9ca0-412c3ddc7649 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:40.313522 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3235067e-0e8f-49b3-9e06-25e3a842732f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:40.314773 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a8da474d-4f42-411c-9ca0-412c3ddc7649 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.212281 Sep 17 21:05:40.315336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 117/226] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:40 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:40.321772 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3235067e-0e8f-49b3-9e06-25e3a842732f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.208650 Sep 17 21:05:40.322320 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 110/227] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:40 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:41.099266 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a4f6537-933c-4746-a7d6-d6782fc9c0fb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:41.099874 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0a4f6537-933c-4746-a7d6-d6782fc9c0fb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:41.106842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a4f6537-933c-4746-a7d6-d6782fc9c0fb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.107326 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a4f6537-933c-4746-a7d6-d6782fc9c0fb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.107762 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a4f6537-933c-4746-a7d6-d6782fc9c0fb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.108459 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a4f6537-933c-4746-a7d6-d6782fc9c0fb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.108947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a4f6537-933c-4746-a7d6-d6782fc9c0fb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.109375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a4f6537-933c-4746-a7d6-d6782fc9c0fb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.110358 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-008e4c88-859e-42fa-99df-49f4b02e60d1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:41.110960 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-008e4c88-859e-42fa-99df-49f4b02e60d1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:41.117420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-008e4c88-859e-42fa-99df-49f4b02e60d1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.118008 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-008e4c88-859e-42fa-99df-49f4b02e60d1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.118435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-008e4c88-859e-42fa-99df-49f4b02e60d1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.119122 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-008e4c88-859e-42fa-99df-49f4b02e60d1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.119568 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-008e4c88-859e-42fa-99df-49f4b02e60d1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.119983 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-008e4c88-859e-42fa-99df-49f4b02e60d1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.306272 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a4f6537-933c-4746-a7d6-d6782fc9c0fb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:41.309558 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-008e4c88-859e-42fa-99df-49f4b02e60d1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:41.313885 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0a4f6537-933c-4746-a7d6-d6782fc9c0fb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.218368 Sep 17 21:05:41.314447 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 118/228] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:41 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:41.317281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-008e4c88-859e-42fa-99df-49f4b02e60d1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.210574 Sep 17 21:05:41.317881 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 111/229] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:41 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:41.337573 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-69aba456-6df2-431c-a28d-51c1134177d1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:41.338305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-69aba456-6df2-431c-a28d-51c1134177d1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:41.344351 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f84cf622-35e4-482a-a66e-92d1688aa2cc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:41.344551 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69aba456-6df2-431c-a28d-51c1134177d1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.344890 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69aba456-6df2-431c-a28d-51c1134177d1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.345061 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f84cf622-35e4-482a-a66e-92d1688aa2cc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:41.345326 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69aba456-6df2-431c-a28d-51c1134177d1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.346019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69aba456-6df2-431c-a28d-51c1134177d1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.346477 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69aba456-6df2-431c-a28d-51c1134177d1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.346900 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69aba456-6df2-431c-a28d-51c1134177d1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.352100 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f84cf622-35e4-482a-a66e-92d1688aa2cc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.352592 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f84cf622-35e4-482a-a66e-92d1688aa2cc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.353058 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f84cf622-35e4-482a-a66e-92d1688aa2cc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.353755 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f84cf622-35e4-482a-a66e-92d1688aa2cc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.354210 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f84cf622-35e4-482a-a66e-92d1688aa2cc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.354632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f84cf622-35e4-482a-a66e-92d1688aa2cc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.537450 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-69aba456-6df2-431c-a28d-51c1134177d1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:41.540914 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f84cf622-35e4-482a-a66e-92d1688aa2cc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:41.546182 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-69aba456-6df2-431c-a28d-51c1134177d1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.212413 Sep 17 21:05:41.546753 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 119/230] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:41 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:41.548366 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f84cf622-35e4-482a-a66e-92d1688aa2cc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.207815 Sep 17 21:05:41.548945 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 112/231] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:41 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:42.337351 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-16dc6022-1b41-43e1-b621-d83ec2b28e58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:42.338051 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-16dc6022-1b41-43e1-b621-d83ec2b28e58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:42.339409 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-49502e6d-e9f8-4562-a796-e3c2b1fad3d2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:42.340034 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-49502e6d-e9f8-4562-a796-e3c2b1fad3d2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:42.344433 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16dc6022-1b41-43e1-b621-d83ec2b28e58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.344910 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16dc6022-1b41-43e1-b621-d83ec2b28e58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.345337 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16dc6022-1b41-43e1-b621-d83ec2b28e58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.346028 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16dc6022-1b41-43e1-b621-d83ec2b28e58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.346176 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49502e6d-e9f8-4562-a796-e3c2b1fad3d2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.346497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16dc6022-1b41-43e1-b621-d83ec2b28e58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.346668 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49502e6d-e9f8-4562-a796-e3c2b1fad3d2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.346903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16dc6022-1b41-43e1-b621-d83ec2b28e58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.347094 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49502e6d-e9f8-4562-a796-e3c2b1fad3d2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.347783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49502e6d-e9f8-4562-a796-e3c2b1fad3d2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.348218 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49502e6d-e9f8-4562-a796-e3c2b1fad3d2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.348636 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49502e6d-e9f8-4562-a796-e3c2b1fad3d2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.550250 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-49502e6d-e9f8-4562-a796-e3c2b1fad3d2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:42.554745 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-16dc6022-1b41-43e1-b621-d83ec2b28e58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:42.558283 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-49502e6d-e9f8-4562-a796-e3c2b1fad3d2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.223040 Sep 17 21:05:42.558872 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 113/232] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:42 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:42.562286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-16dc6022-1b41-43e1-b621-d83ec2b28e58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.229084 Sep 17 21:05:42.562975 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 120/233] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:42 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:42.574148 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a7611164-ec1d-4eb5-94da-76c7c1bd68d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:42.574872 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a7611164-ec1d-4eb5-94da-76c7c1bd68d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:42.578309 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a6ef43a-e137-430c-a7ed-17eac3c6d588 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:42.578925 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a6ef43a-e137-430c-a7ed-17eac3c6d588 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:42.581092 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7611164-ec1d-4eb5-94da-76c7c1bd68d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.581708 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7611164-ec1d-4eb5-94da-76c7c1bd68d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.582287 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7611164-ec1d-4eb5-94da-76c7c1bd68d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.582982 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7611164-ec1d-4eb5-94da-76c7c1bd68d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.583436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7611164-ec1d-4eb5-94da-76c7c1bd68d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.583916 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7611164-ec1d-4eb5-94da-76c7c1bd68d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.584626 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a6ef43a-e137-430c-a7ed-17eac3c6d588 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.585694 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a6ef43a-e137-430c-a7ed-17eac3c6d588 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.586123 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a6ef43a-e137-430c-a7ed-17eac3c6d588 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.586811 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a6ef43a-e137-430c-a7ed-17eac3c6d588 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.587265 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a6ef43a-e137-430c-a7ed-17eac3c6d588 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.587683 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a6ef43a-e137-430c-a7ed-17eac3c6d588 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.771579 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a7611164-ec1d-4eb5-94da-76c7c1bd68d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:42.779906 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9a6ef43a-e137-430c-a7ed-17eac3c6d588 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:42.780033 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a7611164-ec1d-4eb5-94da-76c7c1bd68d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.210043 Sep 17 21:05:42.782825 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 114/234] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:42 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:42.793629 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9a6ef43a-e137-430c-a7ed-17eac3c6d588 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.219828 Sep 17 21:05:42.794367 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 121/235] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:42 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:43.581366 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-49bda251-036a-44df-9bb7-ea5f9434ed2e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:43.581908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-49bda251-036a-44df-9bb7-ea5f9434ed2e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:43.588344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49bda251-036a-44df-9bb7-ea5f9434ed2e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.588860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49bda251-036a-44df-9bb7-ea5f9434ed2e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.589050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d46450c9-d878-4b30-a905-0f32fff52558 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:43.589452 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49bda251-036a-44df-9bb7-ea5f9434ed2e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.589668 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d46450c9-d878-4b30-a905-0f32fff52558 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:43.589976 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49bda251-036a-44df-9bb7-ea5f9434ed2e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.590432 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49bda251-036a-44df-9bb7-ea5f9434ed2e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.590856 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49bda251-036a-44df-9bb7-ea5f9434ed2e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.595597 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d46450c9-d878-4b30-a905-0f32fff52558 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.596092 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d46450c9-d878-4b30-a905-0f32fff52558 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.596529 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d46450c9-d878-4b30-a905-0f32fff52558 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.597249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d46450c9-d878-4b30-a905-0f32fff52558 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.597707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d46450c9-d878-4b30-a905-0f32fff52558 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.598134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d46450c9-d878-4b30-a905-0f32fff52558 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.783963 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-49bda251-036a-44df-9bb7-ea5f9434ed2e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:43.785218 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d46450c9-d878-4b30-a905-0f32fff52558 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:43.793793 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d46450c9-d878-4b30-a905-0f32fff52558 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.208552 Sep 17 21:05:43.794359 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 122/236] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:43 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:43.794909 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-49bda251-036a-44df-9bb7-ea5f9434ed2e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.217441 Sep 17 21:05:43.795483 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 115/237] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:43 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:43.802595 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-98c46a87-cca7-43fe-a317-3824431660f3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:43.803473 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-98c46a87-cca7-43fe-a317-3824431660f3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:43.811579 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98c46a87-cca7-43fe-a317-3824431660f3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.812078 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98c46a87-cca7-43fe-a317-3824431660f3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.812520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98c46a87-cca7-43fe-a317-3824431660f3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.813283 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98c46a87-cca7-43fe-a317-3824431660f3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.813742 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98c46a87-cca7-43fe-a317-3824431660f3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.814168 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98c46a87-cca7-43fe-a317-3824431660f3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.815487 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da42b7ad-46c3-40f2-a8c5-41aa64ee6bb9 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:43.816097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da42b7ad-46c3-40f2-a8c5-41aa64ee6bb9 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:43.822943 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da42b7ad-46c3-40f2-a8c5-41aa64ee6bb9 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.823421 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da42b7ad-46c3-40f2-a8c5-41aa64ee6bb9 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.823846 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da42b7ad-46c3-40f2-a8c5-41aa64ee6bb9 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.824543 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da42b7ad-46c3-40f2-a8c5-41aa64ee6bb9 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.825016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da42b7ad-46c3-40f2-a8c5-41aa64ee6bb9 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.825429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da42b7ad-46c3-40f2-a8c5-41aa64ee6bb9 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.007288 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-98c46a87-cca7-43fe-a317-3824431660f3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:44.014350 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-da42b7ad-46c3-40f2-a8c5-41aa64ee6bb9 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:44.014893 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-98c46a87-cca7-43fe-a317-3824431660f3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.216253 Sep 17 21:05:44.015647 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 123/238] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:43 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:44.022881 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da42b7ad-46c3-40f2-a8c5-41aa64ee6bb9 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.210832 Sep 17 21:05:44.023434 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 116/239] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:43 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:44.817208 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-57de4a7c-64af-4254-9e20-8957dc5a2471 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:44.818184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-57de4a7c-64af-4254-9e20-8957dc5a2471 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:44.818526 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b1773022-b771-4a01-8825-10c80c4f2b2c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:44.820034 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b1773022-b771-4a01-8825-10c80c4f2b2c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:44.824785 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57de4a7c-64af-4254-9e20-8957dc5a2471 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:44.825262 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57de4a7c-64af-4254-9e20-8957dc5a2471 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:44.825690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57de4a7c-64af-4254-9e20-8957dc5a2471 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.826371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57de4a7c-64af-4254-9e20-8957dc5a2471 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:44.826815 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57de4a7c-64af-4254-9e20-8957dc5a2471 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:44.827236 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57de4a7c-64af-4254-9e20-8957dc5a2471 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.827683 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1773022-b771-4a01-8825-10c80c4f2b2c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:44.828249 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1773022-b771-4a01-8825-10c80c4f2b2c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:44.828809 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1773022-b771-4a01-8825-10c80c4f2b2c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.829591 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1773022-b771-4a01-8825-10c80c4f2b2c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:44.830129 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1773022-b771-4a01-8825-10c80c4f2b2c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:44.830633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1773022-b771-4a01-8825-10c80c4f2b2c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.831070 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:45.018819 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-57de4a7c-64af-4254-9e20-8957dc5a2471 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:45.022116 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b1773022-b771-4a01-8825-10c80c4f2b2c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:45.026848 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-57de4a7c-64af-4254-9e20-8957dc5a2471 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.213435 Sep 17 21:05:45.027410 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 124/240] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:44 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:45.035433 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b1773022-b771-4a01-8825-10c80c4f2b2c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.221304 Sep 17 21:05:45.036021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 117/241] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:44 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:45.037664 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c8d0c1a7-df52-4e72-bf6b-3dc21c6b6215 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:45.038866 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c8d0c1a7-df52-4e72-bf6b-3dc21c6b6215 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:45.044793 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d0c1a7-df52-4e72-bf6b-3dc21c6b6215 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:45.045533 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d0c1a7-df52-4e72-bf6b-3dc21c6b6215 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:45.046194 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d0c1a7-df52-4e72-bf6b-3dc21c6b6215 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:45.047101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d0c1a7-df52-4e72-bf6b-3dc21c6b6215 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:45.047713 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d0c1a7-df52-4e72-bf6b-3dc21c6b6215 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:45.048135 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d0c1a7-df52-4e72-bf6b-3dc21c6b6215 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:45.049383 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dea15a63-278f-448b-ac90-862831468616 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:45.054214 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dea15a63-278f-448b-ac90-862831468616 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:45.060186 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dea15a63-278f-448b-ac90-862831468616 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:45.060726 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dea15a63-278f-448b-ac90-862831468616 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:45.061146 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dea15a63-278f-448b-ac90-862831468616 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:45.061838 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dea15a63-278f-448b-ac90-862831468616 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:45.062290 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dea15a63-278f-448b-ac90-862831468616 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:45.062708 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dea15a63-278f-448b-ac90-862831468616 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:45.066987 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:45.250423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c8d0c1a7-df52-4e72-bf6b-3dc21c6b6215 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:45.261549 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dea15a63-278f-448b-ac90-862831468616 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:45.262724 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c8d0c1a7-df52-4e72-bf6b-3dc21c6b6215 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.228703 Sep 17 21:05:45.270511 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dea15a63-278f-448b-ac90-862831468616 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.224483 Sep 17 21:05:45.277759 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 125/242] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:45 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:45.282783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 118/243] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:45 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:45.307548 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2d4b368b-c675-4148-a3d9-3708aa5fc756 req-64cf203a-fed0-4237-9061-50ea732440a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06bc19de-a634-49b9-b594-e66f5a07f584", "name": "network-vif-plugged", "status": "completed", "tag": "a8a5bbd2-ce5f-46bf-b7f6-75feb45e9e31"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:45.320222 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2d4b368b-c675-4148-a3d9-3708aa5fc756 req-64cf203a-fed0-4237-9061-50ea732440a3 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:45.320709 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2d4b368b-c675-4148-a3d9-3708aa5fc756 req-64cf203a-fed0-4237-9061-50ea732440a3 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:45.321134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2d4b368b-c675-4148-a3d9-3708aa5fc756 req-64cf203a-fed0-4237-9061-50ea732440a3 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:45.333063 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2d4b368b-c675-4148-a3d9-3708aa5fc756 req-64cf203a-fed0-4237-9061-50ea732440a3 service nova] Creating event network-vif-plugged:a8a5bbd2-ce5f-46bf-b7f6-75feb45e9e31 for instance 06bc19de-a634-49b9-b594-e66f5a07f584 on hv-cinder-82651 Sep 17 21:05:45.339331 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2d4b368b-c675-4148-a3d9-3708aa5fc756 req-64cf203a-fed0-4237-9061-50ea732440a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036998 Sep 17 21:05:45.339937 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 126/244] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:46.054256 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cc377e5f-a99f-40e7-bf90-6e66ec2a8131 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:46.054861 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cc377e5f-a99f-40e7-bf90-6e66ec2a8131 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:46.059047 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a52d4a85-0118-41b8-b0ed-ee83517b2663 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:46.059748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a52d4a85-0118-41b8-b0ed-ee83517b2663 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:46.060800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc377e5f-a99f-40e7-bf90-6e66ec2a8131 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.061285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc377e5f-a99f-40e7-bf90-6e66ec2a8131 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.061716 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc377e5f-a99f-40e7-bf90-6e66ec2a8131 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.062404 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc377e5f-a99f-40e7-bf90-6e66ec2a8131 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.062860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc377e5f-a99f-40e7-bf90-6e66ec2a8131 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.063280 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc377e5f-a99f-40e7-bf90-6e66ec2a8131 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.065822 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a52d4a85-0118-41b8-b0ed-ee83517b2663 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.066303 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a52d4a85-0118-41b8-b0ed-ee83517b2663 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.066738 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a52d4a85-0118-41b8-b0ed-ee83517b2663 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.067429 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a52d4a85-0118-41b8-b0ed-ee83517b2663 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.067886 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a52d4a85-0118-41b8-b0ed-ee83517b2663 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.068312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a52d4a85-0118-41b8-b0ed-ee83517b2663 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.255976 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cc377e5f-a99f-40e7-bf90-6e66ec2a8131 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:46.260247 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a52d4a85-0118-41b8-b0ed-ee83517b2663 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:46.263768 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cc377e5f-a99f-40e7-bf90-6e66ec2a8131 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.213351 Sep 17 21:05:46.264336 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 119/245] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:46 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:46.267907 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a52d4a85-0118-41b8-b0ed-ee83517b2663 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.212990 Sep 17 21:05:46.268528 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 127/246] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:46 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:46.287061 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d5d55ea8-6466-476f-9754-5fcf81b7d340 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:46.287660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d5d55ea8-6466-476f-9754-5fcf81b7d340 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:46.294434 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5d55ea8-6466-476f-9754-5fcf81b7d340 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.294916 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5d55ea8-6466-476f-9754-5fcf81b7d340 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.295144 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3ed8aa74-fb93-4818-b00e-67e28509f17f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:46.295352 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5d55ea8-6466-476f-9754-5fcf81b7d340 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.295775 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3ed8aa74-fb93-4818-b00e-67e28509f17f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:46.296037 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5d55ea8-6466-476f-9754-5fcf81b7d340 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.296484 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5d55ea8-6466-476f-9754-5fcf81b7d340 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.296959 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5d55ea8-6466-476f-9754-5fcf81b7d340 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.304895 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ed8aa74-fb93-4818-b00e-67e28509f17f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.305014 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ed8aa74-fb93-4818-b00e-67e28509f17f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.305376 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ed8aa74-fb93-4818-b00e-67e28509f17f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.306089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ed8aa74-fb93-4818-b00e-67e28509f17f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.306547 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ed8aa74-fb93-4818-b00e-67e28509f17f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.306972 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ed8aa74-fb93-4818-b00e-67e28509f17f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.518350 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d5d55ea8-6466-476f-9754-5fcf81b7d340 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:46.527806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d5d55ea8-6466-476f-9754-5fcf81b7d340 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.244334 Sep 17 21:05:46.528722 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 120/247] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:46 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:46.533396 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3ed8aa74-fb93-4818-b00e-67e28509f17f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:46.547039 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3ed8aa74-fb93-4818-b00e-67e28509f17f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.255425 Sep 17 21:05:46.548641 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 128/248] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:46 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:47.286716 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d92b8474-1d5d-4c7b-92d4-68b9a995f89f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:47.287491 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d92b8474-1d5d-4c7b-92d4-68b9a995f89f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:47.292161 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f4fa6d2-0f6a-48b7-ad43-497b53bc31a2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:47.293007 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f4fa6d2-0f6a-48b7-ad43-497b53bc31a2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:47.294622 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d92b8474-1d5d-4c7b-92d4-68b9a995f89f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.295132 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d92b8474-1d5d-4c7b-92d4-68b9a995f89f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.295981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d92b8474-1d5d-4c7b-92d4-68b9a995f89f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.296458 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d92b8474-1d5d-4c7b-92d4-68b9a995f89f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.297046 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d92b8474-1d5d-4c7b-92d4-68b9a995f89f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.299931 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d92b8474-1d5d-4c7b-92d4-68b9a995f89f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.300058 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f4fa6d2-0f6a-48b7-ad43-497b53bc31a2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.300058 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f4fa6d2-0f6a-48b7-ad43-497b53bc31a2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.300058 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f4fa6d2-0f6a-48b7-ad43-497b53bc31a2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.303165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f4fa6d2-0f6a-48b7-ad43-497b53bc31a2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.304245 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f4fa6d2-0f6a-48b7-ad43-497b53bc31a2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.304917 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f4fa6d2-0f6a-48b7-ad43-497b53bc31a2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.498997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d92b8474-1d5d-4c7b-92d4-68b9a995f89f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:47.501100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f4fa6d2-0f6a-48b7-ad43-497b53bc31a2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:47.510669 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f4fa6d2-0f6a-48b7-ad43-497b53bc31a2 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.223405 Sep 17 21:05:47.512221 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d92b8474-1d5d-4c7b-92d4-68b9a995f89f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.229419 Sep 17 21:05:47.512378 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 129/249] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:47 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:47.513180 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 121/250] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:47 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:47.560291 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-60dd7902-c008-482b-b067-d5c58e1c5c00 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:47.560852 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-60dd7902-c008-482b-b067-d5c58e1c5c00 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:47.566947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60dd7902-c008-482b-b067-d5c58e1c5c00 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.567446 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60dd7902-c008-482b-b067-d5c58e1c5c00 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.567951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60dd7902-c008-482b-b067-d5c58e1c5c00 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.569239 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60dd7902-c008-482b-b067-d5c58e1c5c00 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.569909 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60dd7902-c008-482b-b067-d5c58e1c5c00 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.570346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60dd7902-c008-482b-b067-d5c58e1c5c00 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.573933 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-db43f226-7653-49f6-9442-b3ff55520478 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:47.574487 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-db43f226-7653-49f6-9442-b3ff55520478 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:47.585151 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db43f226-7653-49f6-9442-b3ff55520478 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.586088 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db43f226-7653-49f6-9442-b3ff55520478 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.586789 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db43f226-7653-49f6-9442-b3ff55520478 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.588234 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db43f226-7653-49f6-9442-b3ff55520478 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.589381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db43f226-7653-49f6-9442-b3ff55520478 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.590182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db43f226-7653-49f6-9442-b3ff55520478 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.794587 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-60dd7902-c008-482b-b067-d5c58e1c5c00 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:47.799023 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-db43f226-7653-49f6-9442-b3ff55520478 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:47.803011 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-60dd7902-c008-482b-b067-d5c58e1c5c00 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.247236 Sep 17 21:05:47.804388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 130/251] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:47 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:47.811383 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-db43f226-7653-49f6-9442-b3ff55520478 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.241896 Sep 17 21:05:47.812708 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 122/252] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:47 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:48.535392 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a77248ee-cdf9-4a3c-ada6-4972be268e11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:48.535996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a77248ee-cdf9-4a3c-ada6-4972be268e11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:48.540210 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4fa4dab2-043b-4bf4-9617-5125c95c5e4c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:48.540883 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4fa4dab2-043b-4bf4-9617-5125c95c5e4c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:48.542231 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77248ee-cdf9-4a3c-ada6-4972be268e11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.542696 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:48.542802 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77248ee-cdf9-4a3c-ada6-4972be268e11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.543136 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77248ee-cdf9-4a3c-ada6-4972be268e11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:48.543848 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77248ee-cdf9-4a3c-ada6-4972be268e11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.544288 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77248ee-cdf9-4a3c-ada6-4972be268e11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.544840 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77248ee-cdf9-4a3c-ada6-4972be268e11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:48.547885 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fa4dab2-043b-4bf4-9617-5125c95c5e4c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.548372 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fa4dab2-043b-4bf4-9617-5125c95c5e4c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.548843 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fa4dab2-043b-4bf4-9617-5125c95c5e4c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:48.549543 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fa4dab2-043b-4bf4-9617-5125c95c5e4c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.550030 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fa4dab2-043b-4bf4-9617-5125c95c5e4c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.550456 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fa4dab2-043b-4bf4-9617-5125c95c5e4c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:48.738086 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a77248ee-cdf9-4a3c-ada6-4972be268e11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:48.742600 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4fa4dab2-043b-4bf4-9617-5125c95c5e4c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:48.746367 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a77248ee-cdf9-4a3c-ada6-4972be268e11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.214838 Sep 17 21:05:48.746928 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 131/253] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:48 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:48.750393 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4fa4dab2-043b-4bf4-9617-5125c95c5e4c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.213975 Sep 17 21:05:48.750979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 123/254] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:48 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:48.825964 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ef1e8f8-b8da-4d88-a2a4-522313dd8d75 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:48.826564 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1ef1e8f8-b8da-4d88-a2a4-522313dd8d75 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:48.832404 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ef1e8f8-b8da-4d88-a2a4-522313dd8d75 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.832918 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ef1e8f8-b8da-4d88-a2a4-522313dd8d75 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.833352 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ef1e8f8-b8da-4d88-a2a4-522313dd8d75 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:48.834042 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ef1e8f8-b8da-4d88-a2a4-522313dd8d75 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.834495 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ef1e8f8-b8da-4d88-a2a4-522313dd8d75 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.834947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ef1e8f8-b8da-4d88-a2a4-522313dd8d75 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:48.836514 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b371b8de-407e-4d07-9040-6df940e70107 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:48.837245 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b371b8de-407e-4d07-9040-6df940e70107 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:48.843109 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b371b8de-407e-4d07-9040-6df940e70107 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.843597 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b371b8de-407e-4d07-9040-6df940e70107 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.844039 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b371b8de-407e-4d07-9040-6df940e70107 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:48.844833 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b371b8de-407e-4d07-9040-6df940e70107 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.845266 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b371b8de-407e-4d07-9040-6df940e70107 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.845668 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b371b8de-407e-4d07-9040-6df940e70107 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.029724 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1ef1e8f8-b8da-4d88-a2a4-522313dd8d75 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:49.032974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b371b8de-407e-4d07-9040-6df940e70107 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:49.037373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ef1e8f8-b8da-4d88-a2a4-522313dd8d75 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.215070 Sep 17 21:05:49.038761 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 132/255] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:48 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:49.041395 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b371b8de-407e-4d07-9040-6df940e70107 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.208841 Sep 17 21:05:49.041960 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 124/256] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:48 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:49.769317 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2ec813a3-5e79-4451-ab53-8c3df32397b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:49.769923 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2ec813a3-5e79-4451-ab53-8c3df32397b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:49.773056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7ee3924-3816-4dc5-ad0f-f137e3bf10ff tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:49.773664 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7ee3924-3816-4dc5-ad0f-f137e3bf10ff tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:49.775839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ec813a3-5e79-4451-ab53-8c3df32397b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:49.776317 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ec813a3-5e79-4451-ab53-8c3df32397b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:49.776770 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ec813a3-5e79-4451-ab53-8c3df32397b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.777458 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ec813a3-5e79-4451-ab53-8c3df32397b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:49.777912 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ec813a3-5e79-4451-ab53-8c3df32397b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:49.778330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ec813a3-5e79-4451-ab53-8c3df32397b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.779515 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7ee3924-3816-4dc5-ad0f-f137e3bf10ff tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:49.779988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7ee3924-3816-4dc5-ad0f-f137e3bf10ff tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:49.780418 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7ee3924-3816-4dc5-ad0f-f137e3bf10ff tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.781126 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7ee3924-3816-4dc5-ad0f-f137e3bf10ff tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:49.781579 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7ee3924-3816-4dc5-ad0f-f137e3bf10ff tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:49.782000 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7ee3924-3816-4dc5-ad0f-f137e3bf10ff tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.970439 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2ec813a3-5e79-4451-ab53-8c3df32397b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:49.973974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7ee3924-3816-4dc5-ad0f-f137e3bf10ff tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:49.978326 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2ec813a3-5e79-4451-ab53-8c3df32397b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.212833 Sep 17 21:05:49.978883 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 133/257] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:49 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:49.982196 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7ee3924-3816-4dc5-ad0f-f137e3bf10ff tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.212867 Sep 17 21:05:49.982743 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 125/258] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:49 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:50.060947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5869d425-cada-42e8-a7b2-40d069648c90 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:50.061555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5869d425-cada-42e8-a7b2-40d069648c90 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:50.063532 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-99c1ff63-b9a5-4555-b8f7-3bd62fee2308 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:50.064134 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99c1ff63-b9a5-4555-b8f7-3bd62fee2308 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:50.067444 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5869d425-cada-42e8-a7b2-40d069648c90 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.067927 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5869d425-cada-42e8-a7b2-40d069648c90 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.068356 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5869d425-cada-42e8-a7b2-40d069648c90 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.069160 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5869d425-cada-42e8-a7b2-40d069648c90 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.069608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5869d425-cada-42e8-a7b2-40d069648c90 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.070062 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5869d425-cada-42e8-a7b2-40d069648c90 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.070159 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99c1ff63-b9a5-4555-b8f7-3bd62fee2308 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.070577 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99c1ff63-b9a5-4555-b8f7-3bd62fee2308 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.071003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99c1ff63-b9a5-4555-b8f7-3bd62fee2308 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.071935 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99c1ff63-b9a5-4555-b8f7-3bd62fee2308 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.072382 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99c1ff63-b9a5-4555-b8f7-3bd62fee2308 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.072831 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99c1ff63-b9a5-4555-b8f7-3bd62fee2308 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.265333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5869d425-cada-42e8-a7b2-40d069648c90 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:50.268474 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-99c1ff63-b9a5-4555-b8f7-3bd62fee2308 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:50.273433 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5869d425-cada-42e8-a7b2-40d069648c90 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.216515 Sep 17 21:05:50.274098 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 134/259] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:50 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:50.276246 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-99c1ff63-b9a5-4555-b8f7-3bd62fee2308 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.216366 Sep 17 21:05:50.276834 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 126/260] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:50 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:51.001563 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17d94211-f14c-4579-84a1-46703faa2658 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:51.002606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-17d94211-f14c-4579-84a1-46703faa2658 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:51.005084 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f771710e-7343-493f-9f8c-5241bb9eb804 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:51.005764 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f771710e-7343-493f-9f8c-5241bb9eb804 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:51.009630 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17d94211-f14c-4579-84a1-46703faa2658 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:51.010113 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17d94211-f14c-4579-84a1-46703faa2658 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:51.010542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17d94211-f14c-4579-84a1-46703faa2658 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:51.011237 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17d94211-f14c-4579-84a1-46703faa2658 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:51.011685 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17d94211-f14c-4579-84a1-46703faa2658 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:51.012103 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17d94211-f14c-4579-84a1-46703faa2658 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:51.012400 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f771710e-7343-493f-9f8c-5241bb9eb804 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:51.013006 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f771710e-7343-493f-9f8c-5241bb9eb804 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:51.013384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f771710e-7343-493f-9f8c-5241bb9eb804 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:51.014062 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f771710e-7343-493f-9f8c-5241bb9eb804 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:51.014508 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f771710e-7343-493f-9f8c-5241bb9eb804 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:51.014928 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f771710e-7343-493f-9f8c-5241bb9eb804 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:51.203188 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-17d94211-f14c-4579-84a1-46703faa2658 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:51.212494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17d94211-f14c-4579-84a1-46703faa2658 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.214823 Sep 17 21:05:51.212948 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f771710e-7343-493f-9f8c-5241bb9eb804 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:51.213171 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 135/261] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:50 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:51.220656 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f771710e-7343-493f-9f8c-5241bb9eb804 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.219403 Sep 17 21:05:51.221230 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 127/262] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:51 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:51.295763 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d2652fd-32f4-46a3-93f8-ffa03258e846 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:51.296370 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9d2652fd-32f4-46a3-93f8-ffa03258e846 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:51.299049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-85fd5c63-110a-4ebe-bb7c-6883c30477a4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:51.299693 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-85fd5c63-110a-4ebe-bb7c-6883c30477a4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:51.302198 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d2652fd-32f4-46a3-93f8-ffa03258e846 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:51.302678 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d2652fd-32f4-46a3-93f8-ffa03258e846 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:51.303101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d2652fd-32f4-46a3-93f8-ffa03258e846 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:51.304289 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d2652fd-32f4-46a3-93f8-ffa03258e846 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:51.304791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d2652fd-32f4-46a3-93f8-ffa03258e846 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:51.305274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d2652fd-32f4-46a3-93f8-ffa03258e846 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:51.306534 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85fd5c63-110a-4ebe-bb7c-6883c30477a4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:51.307014 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85fd5c63-110a-4ebe-bb7c-6883c30477a4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:51.307454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85fd5c63-110a-4ebe-bb7c-6883c30477a4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:51.308147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85fd5c63-110a-4ebe-bb7c-6883c30477a4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:51.308600 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85fd5c63-110a-4ebe-bb7c-6883c30477a4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:51.309050 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85fd5c63-110a-4ebe-bb7c-6883c30477a4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:51.491434 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9d2652fd-32f4-46a3-93f8-ffa03258e846 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:51.495509 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-85fd5c63-110a-4ebe-bb7c-6883c30477a4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:51.499026 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9d2652fd-32f4-46a3-93f8-ffa03258e846 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.207012 Sep 17 21:05:51.499584 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 136/263] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:51 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:51.503090 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-85fd5c63-110a-4ebe-bb7c-6883c30477a4 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.207813 Sep 17 21:05:51.503642 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 128/264] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:51 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:52.235199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-74b54fcb-8d6e-4658-9cd5-253d83502248 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:52.235798 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-74b54fcb-8d6e-4658-9cd5-253d83502248 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:52.237765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=98 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:52.243168 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74b54fcb-8d6e-4658-9cd5-253d83502248 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.243645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74b54fcb-8d6e-4658-9cd5-253d83502248 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.243745 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a704d9be-547d-4163-aa54-f411b7b4f042 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:52.244124 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74b54fcb-8d6e-4658-9cd5-253d83502248 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.244337 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a704d9be-547d-4163-aa54-f411b7b4f042 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:52.244773 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74b54fcb-8d6e-4658-9cd5-253d83502248 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.245226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74b54fcb-8d6e-4658-9cd5-253d83502248 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.245642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74b54fcb-8d6e-4658-9cd5-253d83502248 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.250184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a704d9be-547d-4163-aa54-f411b7b4f042 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.250670 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a704d9be-547d-4163-aa54-f411b7b4f042 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.251107 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a704d9be-547d-4163-aa54-f411b7b4f042 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.251789 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a704d9be-547d-4163-aa54-f411b7b4f042 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.252264 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a704d9be-547d-4163-aa54-f411b7b4f042 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.252708 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a704d9be-547d-4163-aa54-f411b7b4f042 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.447704 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-74b54fcb-8d6e-4658-9cd5-253d83502248 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:52.452300 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a704d9be-547d-4163-aa54-f411b7b4f042 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:52.455814 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-74b54fcb-8d6e-4658-9cd5-253d83502248 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.224282 Sep 17 21:05:52.456390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 137/265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:52 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:52.461249 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a704d9be-547d-4163-aa54-f411b7b4f042 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.221399 Sep 17 21:05:52.461811 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 129/266] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:52 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:52.521245 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e89a68c3-1f68-4467-a8e7-b70fdbc2fd8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:52.521878 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e89a68c3-1f68-4467-a8e7-b70fdbc2fd8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:52.526031 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c98e78f6-28c6-49b6-856c-7cf9487fd9d8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:52.526637 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c98e78f6-28c6-49b6-856c-7cf9487fd9d8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:52.528513 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e89a68c3-1f68-4467-a8e7-b70fdbc2fd8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.529020 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e89a68c3-1f68-4467-a8e7-b70fdbc2fd8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.529447 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e89a68c3-1f68-4467-a8e7-b70fdbc2fd8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.530130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e89a68c3-1f68-4467-a8e7-b70fdbc2fd8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.530576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e89a68c3-1f68-4467-a8e7-b70fdbc2fd8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.530990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e89a68c3-1f68-4467-a8e7-b70fdbc2fd8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.532474 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c98e78f6-28c6-49b6-856c-7cf9487fd9d8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.532992 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c98e78f6-28c6-49b6-856c-7cf9487fd9d8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.533425 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c98e78f6-28c6-49b6-856c-7cf9487fd9d8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.534109 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c98e78f6-28c6-49b6-856c-7cf9487fd9d8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.534758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c98e78f6-28c6-49b6-856c-7cf9487fd9d8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.534990 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c98e78f6-28c6-49b6-856c-7cf9487fd9d8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.717805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e89a68c3-1f68-4467-a8e7-b70fdbc2fd8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:52.722612 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c98e78f6-28c6-49b6-856c-7cf9487fd9d8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:52.725977 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e89a68c3-1f68-4467-a8e7-b70fdbc2fd8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.208407 Sep 17 21:05:52.726744 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 138/267] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:52 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:52.730759 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c98e78f6-28c6-49b6-856c-7cf9487fd9d8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.208864 Sep 17 21:05:52.731442 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 130/268] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:52 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:53.479834 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eae18422-e607-4b98-8cfa-49cef831db90 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:53.480468 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eae18422-e607-4b98-8cfa-49cef831db90 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:53.483198 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-84534815-9838-40ce-8fcc-559381be8030 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:53.483834 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-84534815-9838-40ce-8fcc-559381be8030 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:53.486626 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eae18422-e607-4b98-8cfa-49cef831db90 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:53.487136 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eae18422-e607-4b98-8cfa-49cef831db90 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:53.487564 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eae18422-e607-4b98-8cfa-49cef831db90 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:53.488283 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eae18422-e607-4b98-8cfa-49cef831db90 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:53.488758 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eae18422-e607-4b98-8cfa-49cef831db90 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:53.489185 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eae18422-e607-4b98-8cfa-49cef831db90 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:53.489719 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84534815-9838-40ce-8fcc-559381be8030 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:53.490196 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84534815-9838-40ce-8fcc-559381be8030 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:53.490660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84534815-9838-40ce-8fcc-559381be8030 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:53.491433 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84534815-9838-40ce-8fcc-559381be8030 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:53.491879 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84534815-9838-40ce-8fcc-559381be8030 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:53.492296 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84534815-9838-40ce-8fcc-559381be8030 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:53.676570 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-eae18422-e607-4b98-8cfa-49cef831db90 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:53.680501 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-84534815-9838-40ce-8fcc-559381be8030 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:53.685625 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eae18422-e607-4b98-8cfa-49cef831db90 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.210286 Sep 17 21:05:53.686358 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 139/269] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:53 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:53.687978 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-84534815-9838-40ce-8fcc-559381be8030 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.208716 Sep 17 21:05:53.688529 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 131/270] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:53 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:53.748440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-773ac306-0005-49d2-a18c-1a1317514458 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:53.749073 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-773ac306-0005-49d2-a18c-1a1317514458 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:53.753821 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-59c7cc19-272c-483a-be0b-51ba37f872a8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:53.754425 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-59c7cc19-272c-483a-be0b-51ba37f872a8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:53.755019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-773ac306-0005-49d2-a18c-1a1317514458 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:53.755494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-773ac306-0005-49d2-a18c-1a1317514458 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:53.755921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-773ac306-0005-49d2-a18c-1a1317514458 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:53.756762 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-773ac306-0005-49d2-a18c-1a1317514458 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:53.757225 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-773ac306-0005-49d2-a18c-1a1317514458 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:53.757631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-773ac306-0005-49d2-a18c-1a1317514458 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:53.760400 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59c7cc19-272c-483a-be0b-51ba37f872a8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:53.760931 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59c7cc19-272c-483a-be0b-51ba37f872a8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:53.761365 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59c7cc19-272c-483a-be0b-51ba37f872a8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:53.762050 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59c7cc19-272c-483a-be0b-51ba37f872a8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:53.762508 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59c7cc19-272c-483a-be0b-51ba37f872a8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:53.762927 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59c7cc19-272c-483a-be0b-51ba37f872a8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:53.952049 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-773ac306-0005-49d2-a18c-1a1317514458 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:53.955018 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-59c7cc19-272c-483a-be0b-51ba37f872a8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:53.960627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-773ac306-0005-49d2-a18c-1a1317514458 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.215893 Sep 17 21:05:53.961249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 140/271] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:53 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:53.963897 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-59c7cc19-272c-483a-be0b-51ba37f872a8 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.213829 Sep 17 21:05:53.964460 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 132/272] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:53 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:54.708063 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1893b098-129f-427b-9761-07c77569d9aa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:54.708662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1893b098-129f-427b-9761-07c77569d9aa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:54.710532 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a69c9e0-9afe-4878-9e3c-dd0ea52e7411 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:54.711139 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a69c9e0-9afe-4878-9e3c-dd0ea52e7411 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:54.714785 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1893b098-129f-427b-9761-07c77569d9aa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.715261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1893b098-129f-427b-9761-07c77569d9aa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.715685 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1893b098-129f-427b-9761-07c77569d9aa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.716403 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1893b098-129f-427b-9761-07c77569d9aa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.716880 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1893b098-129f-427b-9761-07c77569d9aa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.716997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a69c9e0-9afe-4878-9e3c-dd0ea52e7411 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.717326 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1893b098-129f-427b-9761-07c77569d9aa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.717429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a69c9e0-9afe-4878-9e3c-dd0ea52e7411 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.717800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a69c9e0-9afe-4878-9e3c-dd0ea52e7411 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.718480 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a69c9e0-9afe-4878-9e3c-dd0ea52e7411 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.718929 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a69c9e0-9afe-4878-9e3c-dd0ea52e7411 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.719346 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a69c9e0-9afe-4878-9e3c-dd0ea52e7411 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.736288 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:54.908148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1893b098-129f-427b-9761-07c77569d9aa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:54.911330 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a69c9e0-9afe-4878-9e3c-dd0ea52e7411 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:54.916476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1893b098-129f-427b-9761-07c77569d9aa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.212178 Sep 17 21:05:54.917070 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 141/273] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:54 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:54.919819 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a69c9e0-9afe-4878-9e3c-dd0ea52e7411 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.213215 Sep 17 21:05:54.920373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 133/274] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:54 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:54.982930 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8bee76d8-86f2-445e-bd37-3cb4604af17a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:54.983464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8bee76d8-86f2-445e-bd37-3cb4604af17a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:54.986474 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f2ad44f0-7f83-45e4-ab0b-ea87f1c4cae5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:54.987100 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f2ad44f0-7f83-45e4-ab0b-ea87f1c4cae5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:54.989312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bee76d8-86f2-445e-bd37-3cb4604af17a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.989802 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bee76d8-86f2-445e-bd37-3cb4604af17a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.990233 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bee76d8-86f2-445e-bd37-3cb4604af17a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.991205 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bee76d8-86f2-445e-bd37-3cb4604af17a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.991901 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bee76d8-86f2-445e-bd37-3cb4604af17a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.992330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bee76d8-86f2-445e-bd37-3cb4604af17a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.992937 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2ad44f0-7f83-45e4-ab0b-ea87f1c4cae5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.993416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2ad44f0-7f83-45e4-ab0b-ea87f1c4cae5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.993841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2ad44f0-7f83-45e4-ab0b-ea87f1c4cae5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.994525 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2ad44f0-7f83-45e4-ab0b-ea87f1c4cae5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.995004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2ad44f0-7f83-45e4-ab0b-ea87f1c4cae5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.995421 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2ad44f0-7f83-45e4-ab0b-ea87f1c4cae5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:55.187410 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8bee76d8-86f2-445e-bd37-3cb4604af17a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:55.191393 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2ad44f0-7f83-45e4-ab0b-ea87f1c4cae5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:55.194972 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:55.195134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8bee76d8-86f2-445e-bd37-3cb4604af17a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.216009 Sep 17 21:05:55.200855 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f2ad44f0-7f83-45e4-ab0b-ea87f1c4cae5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.218161 Sep 17 21:05:55.202406 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 134/275] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:54 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:55.202492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 142/276] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:54 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:55.939926 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6f374ee3-ac23-43c8-aa28-78244b42ba40 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:55.940522 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f374ee3-ac23-43c8-aa28-78244b42ba40 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:55.942380 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3cd7e5af-8c21-4346-9101-1dbcf4622f44 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:55.942983 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3cd7e5af-8c21-4346-9101-1dbcf4622f44 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:55.947715 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f374ee3-ac23-43c8-aa28-78244b42ba40 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:55.948197 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f374ee3-ac23-43c8-aa28-78244b42ba40 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:55.948630 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f374ee3-ac23-43c8-aa28-78244b42ba40 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:55.949357 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f374ee3-ac23-43c8-aa28-78244b42ba40 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:55.949764 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3cd7e5af-8c21-4346-9101-1dbcf4622f44 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:55.949873 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f374ee3-ac23-43c8-aa28-78244b42ba40 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:55.950218 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f374ee3-ac23-43c8-aa28-78244b42ba40 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:55.950322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3cd7e5af-8c21-4346-9101-1dbcf4622f44 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:55.950656 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3cd7e5af-8c21-4346-9101-1dbcf4622f44 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:55.951337 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3cd7e5af-8c21-4346-9101-1dbcf4622f44 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:55.951785 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3cd7e5af-8c21-4346-9101-1dbcf4622f44 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:55.952202 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3cd7e5af-8c21-4346-9101-1dbcf4622f44 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:56.143387 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f374ee3-ac23-43c8-aa28-78244b42ba40 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:56.147095 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3cd7e5af-8c21-4346-9101-1dbcf4622f44 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:56.151705 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6f374ee3-ac23-43c8-aa28-78244b42ba40 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.215796 Sep 17 21:05:56.152418 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 135/277] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:55 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:56.155110 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3cd7e5af-8c21-4346-9101-1dbcf4622f44 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.216442 Sep 17 21:05:56.155816 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 143/278] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:55 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:56.218767 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9fab69d9-85dd-4481-af16-1ef4561a7a83 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:56.219445 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9fab69d9-85dd-4481-af16-1ef4561a7a83 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:56.226134 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fab69d9-85dd-4481-af16-1ef4561a7a83 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:56.226624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fab69d9-85dd-4481-af16-1ef4561a7a83 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:56.227078 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fab69d9-85dd-4481-af16-1ef4561a7a83 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:56.227339 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec85c81e-0a5e-4047-84db-0702ed8903a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:56.228162 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fab69d9-85dd-4481-af16-1ef4561a7a83 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:56.228287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec85c81e-0a5e-4047-84db-0702ed8903a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:56.228367 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fab69d9-85dd-4481-af16-1ef4561a7a83 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:56.228623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fab69d9-85dd-4481-af16-1ef4561a7a83 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:56.235368 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec85c81e-0a5e-4047-84db-0702ed8903a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:56.235855 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec85c81e-0a5e-4047-84db-0702ed8903a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:56.236286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec85c81e-0a5e-4047-84db-0702ed8903a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:56.237403 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec85c81e-0a5e-4047-84db-0702ed8903a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:56.237515 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec85c81e-0a5e-4047-84db-0702ed8903a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:56.237856 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec85c81e-0a5e-4047-84db-0702ed8903a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:56.491566 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9fab69d9-85dd-4481-af16-1ef4561a7a83 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:56.499247 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9fab69d9-85dd-4481-af16-1ef4561a7a83 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.284579 Sep 17 21:05:56.500009 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 136/279] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:56 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:56.519546 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ec85c81e-0a5e-4047-84db-0702ed8903a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:56.528597 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec85c81e-0a5e-4047-84db-0702ed8903a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.307229 Sep 17 21:05:56.529320 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 144/280] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:56 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:57.174567 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1f87adc2-5d9c-4c3d-97b0-f676403be14b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:57.175320 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1f87adc2-5d9c-4c3d-97b0-f676403be14b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:57.179558 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9b5a4050-9f62-4d21-836c-6d3c6478704a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:57.180186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9b5a4050-9f62-4d21-836c-6d3c6478704a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:57.182088 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f87adc2-5d9c-4c3d-97b0-f676403be14b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.182712 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f87adc2-5d9c-4c3d-97b0-f676403be14b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.183495 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f87adc2-5d9c-4c3d-97b0-f676403be14b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.183841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f87adc2-5d9c-4c3d-97b0-f676403be14b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.184295 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f87adc2-5d9c-4c3d-97b0-f676403be14b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.184895 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f87adc2-5d9c-4c3d-97b0-f676403be14b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.186619 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b5a4050-9f62-4d21-836c-6d3c6478704a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.187096 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b5a4050-9f62-4d21-836c-6d3c6478704a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.187587 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b5a4050-9f62-4d21-836c-6d3c6478704a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.188219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b5a4050-9f62-4d21-836c-6d3c6478704a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.188766 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b5a4050-9f62-4d21-836c-6d3c6478704a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.189193 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b5a4050-9f62-4d21-836c-6d3c6478704a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.377169 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1f87adc2-5d9c-4c3d-97b0-f676403be14b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:57.384906 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1f87adc2-5d9c-4c3d-97b0-f676403be14b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.214277 Sep 17 21:05:57.385462 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 137/281] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:57 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:57.390534 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9b5a4050-9f62-4d21-836c-6d3c6478704a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:57.401423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9b5a4050-9f62-4d21-836c-6d3c6478704a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.227575 Sep 17 21:05:57.402247 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 145/282] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:57 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:57.522452 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0593729-f771-4646-b170-2ee609688233 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:57.523097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b0593729-f771-4646-b170-2ee609688233 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:57.529668 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0593729-f771-4646-b170-2ee609688233 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.530245 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0593729-f771-4646-b170-2ee609688233 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.530666 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0593729-f771-4646-b170-2ee609688233 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.531360 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0593729-f771-4646-b170-2ee609688233 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.531814 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0593729-f771-4646-b170-2ee609688233 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.532232 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0593729-f771-4646-b170-2ee609688233 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.565000 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a74c08d8-b6c7-4dc4-b196-0ba41e042397 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:57.565996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a74c08d8-b6c7-4dc4-b196-0ba41e042397 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:57.575324 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a74c08d8-b6c7-4dc4-b196-0ba41e042397 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.575938 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a74c08d8-b6c7-4dc4-b196-0ba41e042397 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.576598 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a74c08d8-b6c7-4dc4-b196-0ba41e042397 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.577675 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a74c08d8-b6c7-4dc4-b196-0ba41e042397 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.578299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a74c08d8-b6c7-4dc4-b196-0ba41e042397 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.578792 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a74c08d8-b6c7-4dc4-b196-0ba41e042397 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:58.040035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a74c08d8-b6c7-4dc4-b196-0ba41e042397 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:58.048317 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a74c08d8-b6c7-4dc4-b196-0ba41e042397 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1315 microversion: 2.1 time: 0.492139 Sep 17 21:05:58.063385 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b0593729-f771-4646-b170-2ee609688233 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:58.063842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 146/283] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:57 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:58.075134 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b0593729-f771-4646-b170-2ee609688233 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.557169 Sep 17 21:05:58.077581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 138/284] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:57 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:58.411683 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-100243b9-1767-4ca6-9e98-45306673fbf4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:58.413517 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-100243b9-1767-4ca6-9e98-45306673fbf4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:58.425403 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87314a6e-a27a-4091-b49e-379ffd2bc0d9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:58.426909 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-87314a6e-a27a-4091-b49e-379ffd2bc0d9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:58.434297 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-100243b9-1767-4ca6-9e98-45306673fbf4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:58.435821 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87314a6e-a27a-4091-b49e-379ffd2bc0d9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:58.436313 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87314a6e-a27a-4091-b49e-379ffd2bc0d9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:58.436773 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87314a6e-a27a-4091-b49e-379ffd2bc0d9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:58.437471 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87314a6e-a27a-4091-b49e-379ffd2bc0d9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:58.437923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87314a6e-a27a-4091-b49e-379ffd2bc0d9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:58.438339 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87314a6e-a27a-4091-b49e-379ffd2bc0d9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:58.442807 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-100243b9-1767-4ca6-9e98-45306673fbf4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:58.443250 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-100243b9-1767-4ca6-9e98-45306673fbf4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:58.444638 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-100243b9-1767-4ca6-9e98-45306673fbf4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:58.445308 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-100243b9-1767-4ca6-9e98-45306673fbf4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:58.445725 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-100243b9-1767-4ca6-9e98-45306673fbf4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:58.667430 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-87314a6e-a27a-4091-b49e-379ffd2bc0d9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:58.675696 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87314a6e-a27a-4091-b49e-379ffd2bc0d9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.255184 Sep 17 21:05:58.676519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 139/285] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:58 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:58.681494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-100243b9-1767-4ca6-9e98-45306673fbf4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:58.690619 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-100243b9-1767-4ca6-9e98-45306673fbf4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.283623 Sep 17 21:05:58.691336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 147/286] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:58 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:59.072120 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4fdc9933-2603-4efc-a682-67b03a77b456 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:59.072772 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4fdc9933-2603-4efc-a682-67b03a77b456 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:59.078653 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fdc9933-2603-4efc-a682-67b03a77b456 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:59.079136 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fdc9933-2603-4efc-a682-67b03a77b456 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:59.079569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fdc9933-2603-4efc-a682-67b03a77b456 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:59.080331 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fdc9933-2603-4efc-a682-67b03a77b456 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:59.080917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fdc9933-2603-4efc-a682-67b03a77b456 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:59.081337 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fdc9933-2603-4efc-a682-67b03a77b456 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:59.098669 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-667c09ff-4693-478f-b09e-2fa6130bfabd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:59.099274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-667c09ff-4693-478f-b09e-2fa6130bfabd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:59.107024 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-667c09ff-4693-478f-b09e-2fa6130bfabd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:59.107505 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-667c09ff-4693-478f-b09e-2fa6130bfabd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:59.107932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-667c09ff-4693-478f-b09e-2fa6130bfabd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:59.108619 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-667c09ff-4693-478f-b09e-2fa6130bfabd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:59.110665 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-667c09ff-4693-478f-b09e-2fa6130bfabd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:59.113085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-667c09ff-4693-478f-b09e-2fa6130bfabd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:59.327078 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4fdc9933-2603-4efc-a682-67b03a77b456 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:59.339230 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4fdc9933-2603-4efc-a682-67b03a77b456 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1503 microversion: 2.1 time: 0.271976 Sep 17 21:05:59.339918 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 140/287] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:59 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:59.379551 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-667c09ff-4693-478f-b09e-2fa6130bfabd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:59.397998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-667c09ff-4693-478f-b09e-2fa6130bfabd tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.303049 Sep 17 21:05:59.402538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 148/288] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:59 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:59.600571 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-67628fcf-057b-486b-9290-cd5ad89c763f req-009659f3-adc6-4386-82fe-1718ae7f357a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38b7550-7fb1-4104-b38d-6ae86dbe3a1e", "name": "network-vif-plugged", "status": "completed", "tag": "9475a995-1a52-4771-b571-1e84b3dbc2f6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:59.618060 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-67628fcf-057b-486b-9290-cd5ad89c763f req-009659f3-adc6-4386-82fe-1718ae7f357a service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:59.623668 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-67628fcf-057b-486b-9290-cd5ad89c763f req-009659f3-adc6-4386-82fe-1718ae7f357a service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:59.625078 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-67628fcf-057b-486b-9290-cd5ad89c763f req-009659f3-adc6-4386-82fe-1718ae7f357a service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:59.663657 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-67628fcf-057b-486b-9290-cd5ad89c763f req-009659f3-adc6-4386-82fe-1718ae7f357a service nova] Creating event network-vif-plugged:9475a995-1a52-4771-b571-1e84b3dbc2f6 for instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e on hv-cinder-82651 Sep 17 21:05:59.676193 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-67628fcf-057b-486b-9290-cd5ad89c763f req-009659f3-adc6-4386-82fe-1718ae7f357a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079414 Sep 17 21:05:59.684813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 141/289] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:59.704290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-045d418b-225f-4b55-80d6-3e8effb5d778 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:59.706378 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-045d418b-225f-4b55-80d6-3e8effb5d778 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:59.719878 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-045d418b-225f-4b55-80d6-3e8effb5d778 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:59.722130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-045d418b-225f-4b55-80d6-3e8effb5d778 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:59.722269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a50ed54d-31df-4a7f-a38f-d86c8a055a91 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:59.723117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a50ed54d-31df-4a7f-a38f-d86c8a055a91 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:59.724113 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-045d418b-225f-4b55-80d6-3e8effb5d778 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:59.726032 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-045d418b-225f-4b55-80d6-3e8effb5d778 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:59.727503 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-045d418b-225f-4b55-80d6-3e8effb5d778 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:59.728393 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-045d418b-225f-4b55-80d6-3e8effb5d778 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:59.736445 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50ed54d-31df-4a7f-a38f-d86c8a055a91 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:59.736987 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50ed54d-31df-4a7f-a38f-d86c8a055a91 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:59.738002 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50ed54d-31df-4a7f-a38f-d86c8a055a91 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:59.740044 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50ed54d-31df-4a7f-a38f-d86c8a055a91 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:59.741708 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50ed54d-31df-4a7f-a38f-d86c8a055a91 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:59.742526 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50ed54d-31df-4a7f-a38f-d86c8a055a91 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:00.023739 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a50ed54d-31df-4a7f-a38f-d86c8a055a91 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:00.038184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a50ed54d-31df-4a7f-a38f-d86c8a055a91 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.322436 Sep 17 21:06:00.039306 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 142/290] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:59 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:00.086052 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-045d418b-225f-4b55-80d6-3e8effb5d778 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:00.097433 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-045d418b-225f-4b55-80d6-3e8effb5d778 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.400451 Sep 17 21:06:00.110654 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 149/291] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:59 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:00.425193 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b956a33-8fa1-46b8-9483-abb8166c9954 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:00.425703 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b956a33-8fa1-46b8-9483-abb8166c9954 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:00.434267 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b956a33-8fa1-46b8-9483-abb8166c9954 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:00.434769 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b956a33-8fa1-46b8-9483-abb8166c9954 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:00.435209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b956a33-8fa1-46b8-9483-abb8166c9954 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:00.435920 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b956a33-8fa1-46b8-9483-abb8166c9954 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:00.436375 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b956a33-8fa1-46b8-9483-abb8166c9954 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:00.436836 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b956a33-8fa1-46b8-9483-abb8166c9954 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:00.596436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b956a33-8fa1-46b8-9483-abb8166c9954 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:00.604644 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b956a33-8fa1-46b8-9483-abb8166c9954 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.183597 Sep 17 21:06:00.606518 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 143/292] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:00 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:01.087834 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7756acb5-74cf-443c-8c3f-f97a86d8dad5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:01.088506 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7756acb5-74cf-443c-8c3f-f97a86d8dad5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:01.088971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-092c7465-e370-4535-b910-d56eca7b1f9f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "929d40bc-e7ec-443c-ac5f-69c2776f1b11"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:01.095015 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-092c7465-e370-4535-b910-d56eca7b1f9f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:01.100520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7756acb5-74cf-443c-8c3f-f97a86d8dad5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.101724 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7756acb5-74cf-443c-8c3f-f97a86d8dad5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.102870 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7756acb5-74cf-443c-8c3f-f97a86d8dad5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.103979 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7756acb5-74cf-443c-8c3f-f97a86d8dad5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.104743 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7756acb5-74cf-443c-8c3f-f97a86d8dad5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.107264 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-092c7465-e370-4535-b910-d56eca7b1f9f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.108069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-092c7465-e370-4535-b910-d56eca7b1f9f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.108585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-092c7465-e370-4535-b910-d56eca7b1f9f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.109433 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-092c7465-e370-4535-b910-d56eca7b1f9f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.110152 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-092c7465-e370-4535-b910-d56eca7b1f9f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.110882 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-092c7465-e370-4535-b910-d56eca7b1f9f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.113281 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7756acb5-74cf-443c-8c3f-f97a86d8dad5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.307830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7756acb5-74cf-443c-8c3f-f97a86d8dad5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:01.317603 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7756acb5-74cf-443c-8c3f-f97a86d8dad5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.258670 Sep 17 21:06:01.318795 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 150/293] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:01 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:01.324008 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d5d41e7-4983-45d2-a886-8713e4d8964c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:01.324618 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3d5d41e7-4983-45d2-a886-8713e4d8964c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:01.330486 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d5d41e7-4983-45d2-a886-8713e4d8964c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.330969 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d5d41e7-4983-45d2-a886-8713e4d8964c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.331398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d5d41e7-4983-45d2-a886-8713e4d8964c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.332258 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d5d41e7-4983-45d2-a886-8713e4d8964c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.332904 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d5d41e7-4983-45d2-a886-8713e4d8964c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.336655 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d5d41e7-4983-45d2-a886-8713e4d8964c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.546552 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3d5d41e7-4983-45d2-a886-8713e4d8964c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:01.556033 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3d5d41e7-4983-45d2-a886-8713e4d8964c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.235966 Sep 17 21:06:01.557261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 151/294] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:01 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:01.629996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cae7268a-2d9d-4cdb-a5cc-d2e3c33ac871 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:01.629996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cae7268a-2d9d-4cdb-a5cc-d2e3c33ac871 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:01.636854 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cae7268a-2d9d-4cdb-a5cc-d2e3c33ac871 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.637450 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cae7268a-2d9d-4cdb-a5cc-d2e3c33ac871 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.637981 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cae7268a-2d9d-4cdb-a5cc-d2e3c33ac871 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.638767 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cae7268a-2d9d-4cdb-a5cc-d2e3c33ac871 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.639427 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cae7268a-2d9d-4cdb-a5cc-d2e3c33ac871 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.640080 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cae7268a-2d9d-4cdb-a5cc-d2e3c33ac871 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.785480 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cae7268a-2d9d-4cdb-a5cc-d2e3c33ac871 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:01.793984 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cae7268a-2d9d-4cdb-a5cc-d2e3c33ac871 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.169323 Sep 17 21:06:01.794927 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 152/295] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:01 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:02.344054 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0ccc6f2d-a30a-4fa8-9833-fa432871c40a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:02.344667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0ccc6f2d-a30a-4fa8-9833-fa432871c40a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:02.351548 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ccc6f2d-a30a-4fa8-9833-fa432871c40a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.352048 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ccc6f2d-a30a-4fa8-9833-fa432871c40a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.352486 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ccc6f2d-a30a-4fa8-9833-fa432871c40a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.353223 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ccc6f2d-a30a-4fa8-9833-fa432871c40a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.353718 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ccc6f2d-a30a-4fa8-9833-fa432871c40a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.354090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ccc6f2d-a30a-4fa8-9833-fa432871c40a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.505745 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0ccc6f2d-a30a-4fa8-9833-fa432871c40a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:02.513751 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0ccc6f2d-a30a-4fa8-9833-fa432871c40a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.173397 Sep 17 21:06:02.514324 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 153/296] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:02 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:02.585009 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0bced969-e3c2-46e5-8446-16b89e48db2e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:02.585672 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0bced969-e3c2-46e5-8446-16b89e48db2e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:02.591894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bced969-e3c2-46e5-8446-16b89e48db2e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.594395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bced969-e3c2-46e5-8446-16b89e48db2e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.595045 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bced969-e3c2-46e5-8446-16b89e48db2e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.595919 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bced969-e3c2-46e5-8446-16b89e48db2e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.596532 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bced969-e3c2-46e5-8446-16b89e48db2e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.597549 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bced969-e3c2-46e5-8446-16b89e48db2e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.758984 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0bced969-e3c2-46e5-8446-16b89e48db2e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:02.766447 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0bced969-e3c2-46e5-8446-16b89e48db2e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.186945 Sep 17 21:06:02.767004 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 154/297] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:02 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:02.819702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b4bdfeba-e769-462d-93d7-224bb3fa6cf5 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:02.820780 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b4bdfeba-e769-462d-93d7-224bb3fa6cf5 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:02.827860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4bdfeba-e769-462d-93d7-224bb3fa6cf5 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.828494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4bdfeba-e769-462d-93d7-224bb3fa6cf5 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.829224 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4bdfeba-e769-462d-93d7-224bb3fa6cf5 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.830436 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4bdfeba-e769-462d-93d7-224bb3fa6cf5 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.831059 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4bdfeba-e769-462d-93d7-224bb3fa6cf5 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.831471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4bdfeba-e769-462d-93d7-224bb3fa6cf5 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.978473 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b4bdfeba-e769-462d-93d7-224bb3fa6cf5 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:02.990236 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b4bdfeba-e769-462d-93d7-224bb3fa6cf5 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1321 microversion: 2.1 time: 0.176856 Sep 17 21:06:03.004703 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 155/298] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:02 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:03.538568 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea75ffe8-e902-4a58-9854-9a878ecb8f11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:03.539319 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea75ffe8-e902-4a58-9854-9a878ecb8f11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:03.545464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea75ffe8-e902-4a58-9854-9a878ecb8f11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:03.546258 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea75ffe8-e902-4a58-9854-9a878ecb8f11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:03.546956 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea75ffe8-e902-4a58-9854-9a878ecb8f11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:03.547757 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea75ffe8-e902-4a58-9854-9a878ecb8f11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:03.548419 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea75ffe8-e902-4a58-9854-9a878ecb8f11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:03.549119 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea75ffe8-e902-4a58-9854-9a878ecb8f11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:03.777678 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea75ffe8-e902-4a58-9854-9a878ecb8f11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:03.791977 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea75ffe8-e902-4a58-9854-9a878ecb8f11 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.256621 Sep 17 21:06:03.793675 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 156/299] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:03 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:03.808954 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7eb8063e-c6ae-4ed5-a5a5-2779bb0704e1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:03.819556 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7eb8063e-c6ae-4ed5-a5a5-2779bb0704e1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:03.833862 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7eb8063e-c6ae-4ed5-a5a5-2779bb0704e1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:03.834777 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7eb8063e-c6ae-4ed5-a5a5-2779bb0704e1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:03.835393 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7eb8063e-c6ae-4ed5-a5a5-2779bb0704e1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:03.837571 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7eb8063e-c6ae-4ed5-a5a5-2779bb0704e1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:03.838277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7eb8063e-c6ae-4ed5-a5a5-2779bb0704e1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:03.839078 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7eb8063e-c6ae-4ed5-a5a5-2779bb0704e1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.074145 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-092c7465-e370-4535-b910-d56eca7b1f9f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "POST /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.992196 Sep 17 21:06:04.074791 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 144/300] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:06:01 2022] POST /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5/os-volume_attachments => generated 194 bytes in 2994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:04.086953 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f365f631-c362-43fc-a54b-effe7f35d6df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:04.088632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f365f631-c362-43fc-a54b-effe7f35d6df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:04.114857 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f365f631-c362-43fc-a54b-effe7f35d6df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.116718 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f365f631-c362-43fc-a54b-effe7f35d6df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.119716 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f365f631-c362-43fc-a54b-effe7f35d6df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.122102 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f365f631-c362-43fc-a54b-effe7f35d6df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.124541 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f365f631-c362-43fc-a54b-effe7f35d6df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.125298 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f365f631-c362-43fc-a54b-effe7f35d6df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.307258 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7eb8063e-c6ae-4ed5-a5a5-2779bb0704e1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:04.317732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7eb8063e-c6ae-4ed5-a5a5-2779bb0704e1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.522672 Sep 17 21:06:04.319408 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 157/301] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:03 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:04.424295 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f365f631-c362-43fc-a54b-effe7f35d6df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:04.434140 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f365f631-c362-43fc-a54b-effe7f35d6df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1514 microversion: 2.1 time: 0.356170 Sep 17 21:06:04.435154 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 145/302] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:04 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1514 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:04.459747 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f33ca6cb-4d42-4baa-bf0b-5f23f3267fc2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:04.462409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f33ca6cb-4d42-4baa-bf0b-5f23f3267fc2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:04.474744 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f33ca6cb-4d42-4baa-bf0b-5f23f3267fc2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.475253 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f33ca6cb-4d42-4baa-bf0b-5f23f3267fc2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.475837 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f33ca6cb-4d42-4baa-bf0b-5f23f3267fc2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.476533 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f33ca6cb-4d42-4baa-bf0b-5f23f3267fc2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.477175 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f33ca6cb-4d42-4baa-bf0b-5f23f3267fc2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.477598 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f33ca6cb-4d42-4baa-bf0b-5f23f3267fc2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.509920 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:04.550651 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-f33ca6cb-4d42-4baa-bf0b-5f23f3267fc2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lazy-loading 'flavor' on Instance uuid 06bc19de-a634-49b9-b594-e66f5a07f584 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:06:04.743854 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f33ca6cb-4d42-4baa-bf0b-5f23f3267fc2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "POST /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584/action" status: 200 len: 32 microversion: 2.1 time: 0.288569 Sep 17 21:06:04.749320 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 158/303] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:04 2022] POST /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584/action => generated 32 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:04.755337 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea70919b-2bdc-46fe-8b1a-968748b6f66b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:04.757008 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea70919b-2bdc-46fe-8b1a-968748b6f66b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:04.763589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea70919b-2bdc-46fe-8b1a-968748b6f66b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.764157 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea70919b-2bdc-46fe-8b1a-968748b6f66b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.764700 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea70919b-2bdc-46fe-8b1a-968748b6f66b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.765541 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea70919b-2bdc-46fe-8b1a-968748b6f66b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.766074 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea70919b-2bdc-46fe-8b1a-968748b6f66b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.766637 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea70919b-2bdc-46fe-8b1a-968748b6f66b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.821842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8cacb460-a420-4317-ba0e-9f6576614807 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:04.822830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8cacb460-a420-4317-ba0e-9f6576614807 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:04.832386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8cacb460-a420-4317-ba0e-9f6576614807 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.832995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8cacb460-a420-4317-ba0e-9f6576614807 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.833437 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8cacb460-a420-4317-ba0e-9f6576614807 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.834464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8cacb460-a420-4317-ba0e-9f6576614807 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.835120 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8cacb460-a420-4317-ba0e-9f6576614807 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.835553 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8cacb460-a420-4317-ba0e-9f6576614807 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:05.023234 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea70919b-2bdc-46fe-8b1a-968748b6f66b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:05.030894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8cacb460-a420-4317-ba0e-9f6576614807 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:05.034009 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea70919b-2bdc-46fe-8b1a-968748b6f66b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.283320 Sep 17 21:06:05.035649 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 146/304] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:04 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:05.042486 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8cacb460-a420-4317-ba0e-9f6576614807 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.225894 Sep 17 21:06:05.043991 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 159/305] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:04 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:05.348192 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-02398395-b409-4603-bd1c-cbf37e8d9785 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:05.348833 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-02398395-b409-4603-bd1c-cbf37e8d9785 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:05.357880 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02398395-b409-4603-bd1c-cbf37e8d9785 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:05.359220 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02398395-b409-4603-bd1c-cbf37e8d9785 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:05.359812 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02398395-b409-4603-bd1c-cbf37e8d9785 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:05.361742 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02398395-b409-4603-bd1c-cbf37e8d9785 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:05.362672 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02398395-b409-4603-bd1c-cbf37e8d9785 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:05.364319 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02398395-b409-4603-bd1c-cbf37e8d9785 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:05.531801 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-610ac3ed-feea-4f41-a01e-fa54ff6c119d req-05ac6e96-8fe3-457d-b312-0d528db8e1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b31e9e6-6a1c-44e8-bcdc-28130872f747", "name": "network-vif-plugged", "status": "completed", "tag": "8904efef-a53d-4fef-b879-3abe2ae8a7c4"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:05.545592 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-610ac3ed-feea-4f41-a01e-fa54ff6c119d req-05ac6e96-8fe3-457d-b312-0d528db8e1a6 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:05.546174 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-610ac3ed-feea-4f41-a01e-fa54ff6c119d req-05ac6e96-8fe3-457d-b312-0d528db8e1a6 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:05.546803 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-610ac3ed-feea-4f41-a01e-fa54ff6c119d req-05ac6e96-8fe3-457d-b312-0d528db8e1a6 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:05.564311 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-610ac3ed-feea-4f41-a01e-fa54ff6c119d req-05ac6e96-8fe3-457d-b312-0d528db8e1a6 service nova] Creating event network-vif-plugged:8904efef-a53d-4fef-b879-3abe2ae8a7c4 for instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 on hv-cinder-82651 Sep 17 21:06:05.579906 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-02398395-b409-4603-bd1c-cbf37e8d9785 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:05.582443 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-610ac3ed-feea-4f41-a01e-fa54ff6c119d req-05ac6e96-8fe3-457d-b312-0d528db8e1a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054591 Sep 17 21:06:05.585955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 160/306] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:05.590928 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-02398395-b409-4603-bd1c-cbf37e8d9785 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1365 microversion: 2.1 time: 0.247644 Sep 17 21:06:05.600720 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 147/307] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:05 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:06.064503 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6fea986a-3621-4160-abd2-7468baf29476 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:06.067578 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6fea986a-3621-4160-abd2-7468baf29476 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:06.073316 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cd5cc904-3cb1-464f-b35c-629866fb8732 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:06.073597 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cd5cc904-3cb1-464f-b35c-629866fb8732 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:06.081578 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd5cc904-3cb1-464f-b35c-629866fb8732 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.082133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd5cc904-3cb1-464f-b35c-629866fb8732 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.082578 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd5cc904-3cb1-464f-b35c-629866fb8732 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.083290 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd5cc904-3cb1-464f-b35c-629866fb8732 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.083749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd5cc904-3cb1-464f-b35c-629866fb8732 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.084997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd5cc904-3cb1-464f-b35c-629866fb8732 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.090703 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6fea986a-3621-4160-abd2-7468baf29476 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.091222 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6fea986a-3621-4160-abd2-7468baf29476 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.091670 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6fea986a-3621-4160-abd2-7468baf29476 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.092394 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6fea986a-3621-4160-abd2-7468baf29476 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.098365 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6fea986a-3621-4160-abd2-7468baf29476 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.099202 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6fea986a-3621-4160-abd2-7468baf29476 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.356881 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6fea986a-3621-4160-abd2-7468baf29476 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:06.364722 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cd5cc904-3cb1-464f-b35c-629866fb8732 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:06.375010 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6fea986a-3621-4160-abd2-7468baf29476 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.317066 Sep 17 21:06:06.379407 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cd5cc904-3cb1-464f-b35c-629866fb8732 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.311897 Sep 17 21:06:06.380317 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 148/308] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:06 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:06.382087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 161/309] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:06 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:06.618719 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-78b8cd6f-8d4a-4610-90fa-82a518a5ba53 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:06.619370 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-78b8cd6f-8d4a-4610-90fa-82a518a5ba53 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:06.625593 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78b8cd6f-8d4a-4610-90fa-82a518a5ba53 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.626074 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78b8cd6f-8d4a-4610-90fa-82a518a5ba53 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.626582 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78b8cd6f-8d4a-4610-90fa-82a518a5ba53 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.627576 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78b8cd6f-8d4a-4610-90fa-82a518a5ba53 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.628040 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78b8cd6f-8d4a-4610-90fa-82a518a5ba53 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.628444 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78b8cd6f-8d4a-4610-90fa-82a518a5ba53 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.777798 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-78b8cd6f-8d4a-4610-90fa-82a518a5ba53 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:06.790665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-78b8cd6f-8d4a-4610-90fa-82a518a5ba53 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1555 microversion: 2.1 time: 0.176821 Sep 17 21:06:06.791311 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 149/310] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:06 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:06.813667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ebda90bd-39d8-4010-b3c5-9028ee60267e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:06.814359 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ebda90bd-39d8-4010-b3c5-9028ee60267e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:06.820492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebda90bd-39d8-4010-b3c5-9028ee60267e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.821253 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebda90bd-39d8-4010-b3c5-9028ee60267e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.821939 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebda90bd-39d8-4010-b3c5-9028ee60267e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.822752 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebda90bd-39d8-4010-b3c5-9028ee60267e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.823277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebda90bd-39d8-4010-b3c5-9028ee60267e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.824455 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebda90bd-39d8-4010-b3c5-9028ee60267e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.909994 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ebda90bd-39d8-4010-b3c5-9028ee60267e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100091 Sep 17 21:06:06.910610 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 162/311] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 17 21:06:06 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:07.414896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-95b562ba-40b3-4ea4-ac3e-c08ff096c487 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:07.415686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-95b562ba-40b3-4ea4-ac3e-c08ff096c487 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:07.421411 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b6b23bc-631c-41b4-b01f-73c55b6cdab8 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:07.422030 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b6b23bc-631c-41b4-b01f-73c55b6cdab8 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:07.426361 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95b562ba-40b3-4ea4-ac3e-c08ff096c487 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.427088 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95b562ba-40b3-4ea4-ac3e-c08ff096c487 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.429103 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95b562ba-40b3-4ea4-ac3e-c08ff096c487 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:07.430213 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95b562ba-40b3-4ea4-ac3e-c08ff096c487 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.430874 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95b562ba-40b3-4ea4-ac3e-c08ff096c487 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.430982 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b6b23bc-631c-41b4-b01f-73c55b6cdab8 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.431887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b6b23bc-631c-41b4-b01f-73c55b6cdab8 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.432338 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b6b23bc-631c-41b4-b01f-73c55b6cdab8 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:07.432735 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95b562ba-40b3-4ea4-ac3e-c08ff096c487 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:07.433088 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b6b23bc-631c-41b4-b01f-73c55b6cdab8 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.441603 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b6b23bc-631c-41b4-b01f-73c55b6cdab8 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.446450 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b6b23bc-631c-41b4-b01f-73c55b6cdab8 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.157653 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b6b23bc-631c-41b4-b01f-73c55b6cdab8 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:08.158537 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-95b562ba-40b3-4ea4-ac3e-c08ff096c487 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:08.163388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:08.167368 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b6b23bc-631c-41b4-b01f-73c55b6cdab8 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.752269 Sep 17 21:06:08.167954 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 163/312] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:07 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:08.186121 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-95b562ba-40b3-4ea4-ac3e-c08ff096c487 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1363 microversion: 2.1 time: 0.778126 Sep 17 21:06:08.200892 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 150/313] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:07 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1363 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:08.949421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-10b6a2be-c995-47f9-9576-776b1ab84dbd req-5b5abc9c-8934-4458-bd9d-1dae5fb1d5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38b7550-7fb1-4104-b38d-6ae86dbe3a1e", "tag": "9475a995-1a52-4771-b571-1e84b3dbc2f6"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:08.949421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-10b6a2be-c995-47f9-9576-776b1ab84dbd req-5b5abc9c-8934-4458-bd9d-1dae5fb1d5ca service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.949421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-10b6a2be-c995-47f9-9576-776b1ab84dbd req-5b5abc9c-8934-4458-bd9d-1dae5fb1d5ca service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.949688 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-10b6a2be-c995-47f9-9576-776b1ab84dbd req-5b5abc9c-8934-4458-bd9d-1dae5fb1d5ca service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.973768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-10b6a2be-c995-47f9-9576-776b1ab84dbd req-5b5abc9c-8934-4458-bd9d-1dae5fb1d5ca service nova] Creating event network-changed:9475a995-1a52-4771-b571-1e84b3dbc2f6 for instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e on hv-cinder-82651 Sep 17 21:06:08.981654 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-10b6a2be-c995-47f9-9576-776b1ab84dbd req-5b5abc9c-8934-4458-bd9d-1dae5fb1d5ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046398 Sep 17 21:06:08.982258 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 164/314] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:09.195937 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f89d225a-4da9-4f28-90ae-5c9a3ae31c2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:09.197485 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f89d225a-4da9-4f28-90ae-5c9a3ae31c2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:09.213108 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f89d225a-4da9-4f28-90ae-5c9a3ae31c2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:09.213602 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f89d225a-4da9-4f28-90ae-5c9a3ae31c2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:09.214034 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f89d225a-4da9-4f28-90ae-5c9a3ae31c2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:09.214739 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f89d225a-4da9-4f28-90ae-5c9a3ae31c2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:09.215179 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f89d225a-4da9-4f28-90ae-5c9a3ae31c2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:09.217286 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f89d225a-4da9-4f28-90ae-5c9a3ae31c2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:09.220436 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e5d91366-0088-436e-a682-9bbc14c9214e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:09.222783 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e5d91366-0088-436e-a682-9bbc14c9214e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:09.242182 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5d91366-0088-436e-a682-9bbc14c9214e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:09.242687 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5d91366-0088-436e-a682-9bbc14c9214e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:09.243146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5d91366-0088-436e-a682-9bbc14c9214e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:09.247041 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5d91366-0088-436e-a682-9bbc14c9214e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:09.247513 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5d91366-0088-436e-a682-9bbc14c9214e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:09.247949 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5d91366-0088-436e-a682-9bbc14c9214e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:09.735496 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f89d225a-4da9-4f28-90ae-5c9a3ae31c2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:09.749990 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f89d225a-4da9-4f28-90ae-5c9a3ae31c2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.562886 Sep 17 21:06:09.750910 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 151/315] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:09 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:09.834413 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e5d91366-0088-436e-a682-9bbc14c9214e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:09.844193 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e5d91366-0088-436e-a682-9bbc14c9214e tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1549 microversion: 2.1 time: 0.635666 Sep 17 21:06:09.845260 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 165/316] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:09 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1549 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:09.868206 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2a6e5990-60b0-4210-8842-3d210894386c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:09.868779 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2a6e5990-60b0-4210-8842-3d210894386c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:09.882923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a6e5990-60b0-4210-8842-3d210894386c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:09.883639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a6e5990-60b0-4210-8842-3d210894386c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:09.884271 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a6e5990-60b0-4210-8842-3d210894386c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:09.885187 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a6e5990-60b0-4210-8842-3d210894386c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:09.886066 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a6e5990-60b0-4210-8842-3d210894386c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:09.886644 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a6e5990-60b0-4210-8842-3d210894386c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:10.027569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2a6e5990-60b0-4210-8842-3d210894386c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159107 Sep 17 21:06:10.028402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 152/317] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 17 21:06:09 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/os-interface => generated 285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:10.773648 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65038124-0513-4e9f-8604-7a8401718376 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:10.774708 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-65038124-0513-4e9f-8604-7a8401718376 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:10.790867 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65038124-0513-4e9f-8604-7a8401718376 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:10.792412 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65038124-0513-4e9f-8604-7a8401718376 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:10.793257 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65038124-0513-4e9f-8604-7a8401718376 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:10.794466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65038124-0513-4e9f-8604-7a8401718376 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:10.795404 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65038124-0513-4e9f-8604-7a8401718376 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:10.796047 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65038124-0513-4e9f-8604-7a8401718376 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.050204 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-65038124-0513-4e9f-8604-7a8401718376 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:11.063110 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-65038124-0513-4e9f-8604-7a8401718376 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.294085 Sep 17 21:06:11.073339 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 166/318] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:10 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:11.400337 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3974cb10-591c-4352-b318-7d69deb4c004 req-f242be11-691a-42ef-8f34-fd064606a765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b31e9e6-6a1c-44e8-bcdc-28130872f747", "tag": "8904efef-a53d-4fef-b879-3abe2ae8a7c4"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:11.410091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3974cb10-591c-4352-b318-7d69deb4c004 req-f242be11-691a-42ef-8f34-fd064606a765 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.410780 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3974cb10-591c-4352-b318-7d69deb4c004 req-f242be11-691a-42ef-8f34-fd064606a765 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.411366 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3974cb10-591c-4352-b318-7d69deb4c004 req-f242be11-691a-42ef-8f34-fd064606a765 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.424940 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3974cb10-591c-4352-b318-7d69deb4c004 req-f242be11-691a-42ef-8f34-fd064606a765 service nova] Creating event network-changed:8904efef-a53d-4fef-b879-3abe2ae8a7c4 for instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 on hv-cinder-82651 Sep 17 21:06:11.431629 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3974cb10-591c-4352-b318-7d69deb4c004 req-f242be11-691a-42ef-8f34-fd064606a765 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036406 Sep 17 21:06:11.432818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 153/319] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:12.090999 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7d518cda-143f-46c5-8d81-583efca15cea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:12.092166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7d518cda-143f-46c5-8d81-583efca15cea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:12.105539 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d518cda-143f-46c5-8d81-583efca15cea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:12.107634 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d518cda-143f-46c5-8d81-583efca15cea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:12.108339 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d518cda-143f-46c5-8d81-583efca15cea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:12.110711 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d518cda-143f-46c5-8d81-583efca15cea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:12.111286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d518cda-143f-46c5-8d81-583efca15cea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:12.112208 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d518cda-143f-46c5-8d81-583efca15cea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:12.279209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7d518cda-143f-46c5-8d81-583efca15cea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:12.288614 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7d518cda-143f-46c5-8d81-583efca15cea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.205527 Sep 17 21:06:12.289222 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 167/320] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:12 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:13.318758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2c14d8e-d4bf-40ce-ad25-0583a4a35305 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:13.320136 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2c14d8e-d4bf-40ce-ad25-0583a4a35305 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:13.332149 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2c14d8e-d4bf-40ce-ad25-0583a4a35305 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:13.333248 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2c14d8e-d4bf-40ce-ad25-0583a4a35305 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:13.334870 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2c14d8e-d4bf-40ce-ad25-0583a4a35305 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:13.335949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2c14d8e-d4bf-40ce-ad25-0583a4a35305 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:13.336416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2c14d8e-d4bf-40ce-ad25-0583a4a35305 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:13.339578 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2c14d8e-d4bf-40ce-ad25-0583a4a35305 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:13.623129 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d2c14d8e-d4bf-40ce-ad25-0583a4a35305 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:13.636032 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2c14d8e-d4bf-40ce-ad25-0583a4a35305 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.324362 Sep 17 21:06:13.636942 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 154/321] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:13 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:14.129562 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8521a8c0-f45d-4f95-b5e1-9f47773b8635 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:14.130600 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8521a8c0-f45d-4f95-b5e1-9f47773b8635 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:14.138269 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8521a8c0-f45d-4f95-b5e1-9f47773b8635 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:14.139113 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8521a8c0-f45d-4f95-b5e1-9f47773b8635 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:14.139657 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8521a8c0-f45d-4f95-b5e1-9f47773b8635 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:14.140362 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8521a8c0-f45d-4f95-b5e1-9f47773b8635 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:14.140853 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8521a8c0-f45d-4f95-b5e1-9f47773b8635 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:14.141274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8521a8c0-f45d-4f95-b5e1-9f47773b8635 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:14.192589 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8521a8c0-f45d-4f95-b5e1-9f47773b8635 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:06:14.300092 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8521a8c0-f45d-4f95-b5e1-9f47773b8635 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 204 len: 0 microversion: 2.1 time: 0.179744 Sep 17 21:06:14.301296 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 168/322] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:06:14 2022] DELETE /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:06:14.310165 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3a53f6c1-a2d3-4426-9167-2c41736c15a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:14.311146 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3a53f6c1-a2d3-4426-9167-2c41736c15a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:14.318065 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a53f6c1-a2d3-4426-9167-2c41736c15a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:14.318863 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a53f6c1-a2d3-4426-9167-2c41736c15a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:14.320104 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a53f6c1-a2d3-4426-9167-2c41736c15a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:14.321535 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a53f6c1-a2d3-4426-9167-2c41736c15a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:14.322178 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a53f6c1-a2d3-4426-9167-2c41736c15a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:14.322884 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a53f6c1-a2d3-4426-9167-2c41736c15a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:14.495070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3a53f6c1-a2d3-4426-9167-2c41736c15a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:14.503260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3a53f6c1-a2d3-4426-9167-2c41736c15a5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1555 microversion: 2.1 time: 0.197093 Sep 17 21:06:14.504128 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 155/323] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:14 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1555 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:14.662970 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e09c3762-55bc-4d7b-ae80-8acd15d25e34 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:14.664110 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e09c3762-55bc-4d7b-ae80-8acd15d25e34 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:14.671624 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09c3762-55bc-4d7b-ae80-8acd15d25e34 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:14.672986 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09c3762-55bc-4d7b-ae80-8acd15d25e34 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:14.673913 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09c3762-55bc-4d7b-ae80-8acd15d25e34 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:14.681218 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09c3762-55bc-4d7b-ae80-8acd15d25e34 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:14.681949 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09c3762-55bc-4d7b-ae80-8acd15d25e34 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:14.682482 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09c3762-55bc-4d7b-ae80-8acd15d25e34 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:14.857369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e09c3762-55bc-4d7b-ae80-8acd15d25e34 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:14.867080 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e09c3762-55bc-4d7b-ae80-8acd15d25e34 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.209139 Sep 17 21:06:14.867642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 169/324] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:14 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:15.526117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aea65862-fe04-4357-8456-ac320d6c214f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:15.526749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aea65862-fe04-4357-8456-ac320d6c214f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:15.533454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aea65862-fe04-4357-8456-ac320d6c214f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.534001 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aea65862-fe04-4357-8456-ac320d6c214f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.534463 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aea65862-fe04-4357-8456-ac320d6c214f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:15.535163 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aea65862-fe04-4357-8456-ac320d6c214f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.535612 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aea65862-fe04-4357-8456-ac320d6c214f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.536028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aea65862-fe04-4357-8456-ac320d6c214f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:15.665235 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-aea65862-fe04-4357-8456-ac320d6c214f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:15.673570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aea65862-fe04-4357-8456-ac320d6c214f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1555 microversion: 2.1 time: 0.151166 Sep 17 21:06:15.674127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 156/325] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:15 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:15.890141 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4cda1f5-6a04-42bb-b22e-6f77c20a4c0c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:15.890753 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4cda1f5-6a04-42bb-b22e-6f77c20a4c0c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:15.896644 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4cda1f5-6a04-42bb-b22e-6f77c20a4c0c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.897166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4cda1f5-6a04-42bb-b22e-6f77c20a4c0c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.897605 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4cda1f5-6a04-42bb-b22e-6f77c20a4c0c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:15.898304 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4cda1f5-6a04-42bb-b22e-6f77c20a4c0c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.898760 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4cda1f5-6a04-42bb-b22e-6f77c20a4c0c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.903899 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4cda1f5-6a04-42bb-b22e-6f77c20a4c0c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:16.044416 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4cda1f5-6a04-42bb-b22e-6f77c20a4c0c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:16.053169 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4cda1f5-6a04-42bb-b22e-6f77c20a4c0c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.166800 Sep 17 21:06:16.053745 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 170/326] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:15 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:16.697617 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0bfc354e-4fb1-4d3a-84c2-9133438aefcc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:16.698235 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0bfc354e-4fb1-4d3a-84c2-9133438aefcc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:16.704967 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfc354e-4fb1-4d3a-84c2-9133438aefcc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:16.705453 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfc354e-4fb1-4d3a-84c2-9133438aefcc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:16.705900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfc354e-4fb1-4d3a-84c2-9133438aefcc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:16.706626 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfc354e-4fb1-4d3a-84c2-9133438aefcc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:16.707081 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfc354e-4fb1-4d3a-84c2-9133438aefcc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:16.707499 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfc354e-4fb1-4d3a-84c2-9133438aefcc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:16.838845 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0bfc354e-4fb1-4d3a-84c2-9133438aefcc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:16.846939 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0bfc354e-4fb1-4d3a-84c2-9133438aefcc tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1555 microversion: 2.1 time: 0.153491 Sep 17 21:06:16.847490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 157/327] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:16 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:17.076555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10ce38d3-eaf4-4651-bce2-d3a192809b21 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:17.077184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-10ce38d3-eaf4-4651-bce2-d3a192809b21 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:17.086159 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ce38d3-eaf4-4651-bce2-d3a192809b21 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:17.086888 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ce38d3-eaf4-4651-bce2-d3a192809b21 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:17.087535 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ce38d3-eaf4-4651-bce2-d3a192809b21 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:17.088582 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ce38d3-eaf4-4651-bce2-d3a192809b21 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:17.089386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ce38d3-eaf4-4651-bce2-d3a192809b21 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:17.090033 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ce38d3-eaf4-4651-bce2-d3a192809b21 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:17.374299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-10ce38d3-eaf4-4651-bce2-d3a192809b21 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:17.382453 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-10ce38d3-eaf4-4651-bce2-d3a192809b21 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.309682 Sep 17 21:06:17.383151 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 171/328] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:17 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:17.871036 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-719b4d8b-f29f-4f02-919d-443136d824c5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:17.871652 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-719b4d8b-f29f-4f02-919d-443136d824c5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:17.880905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-719b4d8b-f29f-4f02-919d-443136d824c5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:17.881412 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-719b4d8b-f29f-4f02-919d-443136d824c5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:17.881946 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-719b4d8b-f29f-4f02-919d-443136d824c5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:17.882659 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-719b4d8b-f29f-4f02-919d-443136d824c5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:17.883123 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-719b4d8b-f29f-4f02-919d-443136d824c5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:17.883549 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-719b4d8b-f29f-4f02-919d-443136d824c5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:18.111750 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a53fe7c8-cef5-4676-a64c-fec9602120c3 req-0ee35b20-c277-428f-9430-a287e9302c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d0d277-2981-45b9-88e1-1d9dd5aaaff5", "name": "network-vif-deleted", "tag": "060a7e1b-7fa9-476f-b5fa-fbf114cbea0a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:18.123689 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a53fe7c8-cef5-4676-a64c-fec9602120c3 req-0ee35b20-c277-428f-9430-a287e9302c9f service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:18.124506 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a53fe7c8-cef5-4676-a64c-fec9602120c3 req-0ee35b20-c277-428f-9430-a287e9302c9f service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:18.125218 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a53fe7c8-cef5-4676-a64c-fec9602120c3 req-0ee35b20-c277-428f-9430-a287e9302c9f service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:18.148029 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-719b4d8b-f29f-4f02-919d-443136d824c5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:18.154555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a53fe7c8-cef5-4676-a64c-fec9602120c3 req-0ee35b20-c277-428f-9430-a287e9302c9f service nova] Creating event network-vif-deleted:060a7e1b-7fa9-476f-b5fa-fbf114cbea0a for instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 on hv-cinder-82651 Sep 17 21:06:18.159106 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-719b4d8b-f29f-4f02-919d-443136d824c5 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1555 microversion: 2.1 time: 0.291153 Sep 17 21:06:18.159827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 158/329] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:17 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:18.160247 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a53fe7c8-cef5-4676-a64c-fec9602120c3 req-0ee35b20-c277-428f-9430-a287e9302c9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052393 Sep 17 21:06:18.161005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 172/330] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:06:18.408178 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-380894a0-761f-41b1-9165-36a28358da29 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:18.408964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-380894a0-761f-41b1-9165-36a28358da29 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:18.415537 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-380894a0-761f-41b1-9165-36a28358da29 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:18.416015 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-380894a0-761f-41b1-9165-36a28358da29 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:18.416450 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-380894a0-761f-41b1-9165-36a28358da29 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:18.417167 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-380894a0-761f-41b1-9165-36a28358da29 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:18.417620 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-380894a0-761f-41b1-9165-36a28358da29 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:18.418068 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-380894a0-761f-41b1-9165-36a28358da29 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:18.553703 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-380894a0-761f-41b1-9165-36a28358da29 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:18.567790 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-380894a0-761f-41b1-9165-36a28358da29 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.164161 Sep 17 21:06:18.568578 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 159/331] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:18 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:19.185208 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:19.186086 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:19.192261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.192921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.193396 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.194101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.194559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.194990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.218144 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:19.233014 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.233567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.234002 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.234443 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lazy-loading 'fault' on Instance uuid 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:06:19.278916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa4420540af41e4967b0f731f818af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4440dd2464bcb95e25ead37c5658a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:19.287846 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b7b379b-8a8c-4857-8db1-777e92048f0f tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 200 len: 1351 microversion: 2.1 time: 0.107600 Sep 17 21:06:19.288408 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 173/332] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:19 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:19.590657 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e42e108-f8f9-4eff-a162-062fc381b30e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:19.591275 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1e42e108-f8f9-4eff-a162-062fc381b30e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:19.593772 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=74 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:19.600002 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e42e108-f8f9-4eff-a162-062fc381b30e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.600486 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e42e108-f8f9-4eff-a162-062fc381b30e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.600944 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e42e108-f8f9-4eff-a162-062fc381b30e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.601725 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e42e108-f8f9-4eff-a162-062fc381b30e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.602178 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e42e108-f8f9-4eff-a162-062fc381b30e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.602599 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e42e108-f8f9-4eff-a162-062fc381b30e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.739126 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1e42e108-f8f9-4eff-a162-062fc381b30e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:19.748242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1e42e108-f8f9-4eff-a162-062fc381b30e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.161383 Sep 17 21:06:19.749001 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 160/333] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:19 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:20.312501 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-83e120e7-9da5-49bd-ad24-06192cb11c32 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:20.313824 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-83e120e7-9da5-49bd-ad24-06192cb11c32 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:20.321572 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83e120e7-9da5-49bd-ad24-06192cb11c32 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:20.322062 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83e120e7-9da5-49bd-ad24-06192cb11c32 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:20.322500 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83e120e7-9da5-49bd-ad24-06192cb11c32 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:20.323238 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83e120e7-9da5-49bd-ad24-06192cb11c32 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:20.323696 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83e120e7-9da5-49bd-ad24-06192cb11c32 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:20.324119 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83e120e7-9da5-49bd-ad24-06192cb11c32 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:20.338159 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-83e120e7-9da5-49bd-ad24-06192cb11c32 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] HTTP exception thrown: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-83e120e7-9da5-49bd-ad24-06192cb11c32 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Request method failure captured: Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 HTTP/1.1 Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZbWDX1OExU8MlqW5YX86Tdq7I_20Ldar_4EDDzpCsfIwyhuCautrFs7M-qqtXbD68S6nSAJeIHLI8K6ik_tBybZWq8DNnSSUBPUuor9QK7cgcwJq4Q0-2eBqC-dlr8xP85BWRDY5wfSmdtMmYLPchphtBV1ctUB09aal12ZFbbkEo Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: 43d4440dd2464bcb95e25ead37c5658a Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-985884000 Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:06:20.342894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:06:20.344475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:06:20.344475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-985884000 Sep 17 21:06:20.344475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 43d4440dd2464bcb95e25ead37c5658a Sep 17 21:06:20.344475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-985884000 Sep 17 21:06:20.344475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-985884000-project Sep 17 21:06:20.344475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:06:20.344475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:06:20.344475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 1fa4420540af41e4967b0f731f818af5 Sep 17 21:06:20.344475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-985884000-project Sep 17 21:06:20.344475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:06:20.344475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:20.344475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '43d0d277-2981-45b9-88e1-1d9dd5aaaff5'} Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:20.345388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:20.346768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:06:20.348005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-83e120e7-9da5-49bd-ad24-06192cb11c32 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Returning 404 to user: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:20.348005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-83e120e7-9da5-49bd-ad24-06192cb11c32 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 404 len: 111 microversion: 2.1 time: 0.036893 Sep 17 21:06:20.348005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 174/334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:20 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:20.571459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-902baf81-d04e-4c31-9cc8-8e8f2205ba4a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:20.574395 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-902baf81-d04e-4c31-9cc8-8e8f2205ba4a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:20.580510 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-902baf81-d04e-4c31-9cc8-8e8f2205ba4a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:20.581048 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-902baf81-d04e-4c31-9cc8-8e8f2205ba4a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:20.581827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-902baf81-d04e-4c31-9cc8-8e8f2205ba4a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:20.582749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-902baf81-d04e-4c31-9cc8-8e8f2205ba4a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:20.583240 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-902baf81-d04e-4c31-9cc8-8e8f2205ba4a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:20.583703 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-902baf81-d04e-4c31-9cc8-8e8f2205ba4a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:20.600821 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-902baf81-d04e-4c31-9cc8-8e8f2205ba4a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] HTTP exception thrown: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-902baf81-d04e-4c31-9cc8-8e8f2205ba4a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Request method failure captured: Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5/os-volume_attachments HTTP/1.1 Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZbWDX1OExU8MlqW5YX86Tdq7I_20Ldar_4EDDzpCsfIwyhuCautrFs7M-qqtXbD68S6nSAJeIHLI8K6ik_tBybZWq8DNnSSUBPUuor9QK7cgcwJq4Q0-2eBqC-dlr8xP85BWRDY5wfSmdtMmYLPchphtBV1ctUB09aal12ZFbbkEo Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: 43d4440dd2464bcb95e25ead37c5658a Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-985884000 Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:06:20.605402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:06:20.606854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:06:20.606854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-985884000 Sep 17 21:06:20.606854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 43d4440dd2464bcb95e25ead37c5658a Sep 17 21:06:20.606854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-985884000 Sep 17 21:06:20.606854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-985884000-project Sep 17 21:06:20.606854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:06:20.606854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:06:20.606854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1fa4420540af41e4967b0f731f818af5 Sep 17 21:06:20.606854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-985884000-project Sep 17 21:06:20.606854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:06:20.606854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:20.606854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'server_id': '43d0d277-2981-45b9-88e1-1d9dd5aaaff5'} Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:20.607893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:20.609209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:06:20.611560 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-902baf81-d04e-4c31-9cc8-8e8f2205ba4a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Returning 404 to user: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:20.611560 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-902baf81-d04e-4c31-9cc8-8e8f2205ba4a tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041373 Sep 17 21:06:20.611560 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 161/335] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:06:20 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:06:20.771129 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49148d25-cbee-459b-a5b3-f7164d6aecd6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:20.771744 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49148d25-cbee-459b-a5b3-f7164d6aecd6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:20.794974 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49148d25-cbee-459b-a5b3-f7164d6aecd6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:20.795511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49148d25-cbee-459b-a5b3-f7164d6aecd6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:20.796038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49148d25-cbee-459b-a5b3-f7164d6aecd6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:20.796964 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49148d25-cbee-459b-a5b3-f7164d6aecd6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:20.797625 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49148d25-cbee-459b-a5b3-f7164d6aecd6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:20.798060 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49148d25-cbee-459b-a5b3-f7164d6aecd6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:20.938153 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-49148d25-cbee-459b-a5b3-f7164d6aecd6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:20.947129 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49148d25-cbee-459b-a5b3-f7164d6aecd6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.179866 Sep 17 21:06:20.947948 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 175/336] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:20 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:21.970589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16cdfa73-f6b2-46a6-a560-67aa6a2d1787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:21.971842 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-16cdfa73-f6b2-46a6-a560-67aa6a2d1787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:21.980852 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16cdfa73-f6b2-46a6-a560-67aa6a2d1787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:21.981342 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16cdfa73-f6b2-46a6-a560-67aa6a2d1787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:21.981771 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16cdfa73-f6b2-46a6-a560-67aa6a2d1787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:21.982604 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16cdfa73-f6b2-46a6-a560-67aa6a2d1787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:21.983054 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16cdfa73-f6b2-46a6-a560-67aa6a2d1787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:21.983560 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16cdfa73-f6b2-46a6-a560-67aa6a2d1787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.126445 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-16cdfa73-f6b2-46a6-a560-67aa6a2d1787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:22.135794 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16cdfa73-f6b2-46a6-a560-67aa6a2d1787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.169281 Sep 17 21:06:22.136472 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 162/337] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:21 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:22.973509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0456c471-39d5-40b7-beb6-13e4c98ff9ee tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:22.974194 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0456c471-39d5-40b7-beb6-13e4c98ff9ee tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:22.976353 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:22.981348 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0456c471-39d5-40b7-beb6-13e4c98ff9ee tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:22.981824 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0456c471-39d5-40b7-beb6-13e4c98ff9ee tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:22.982543 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0456c471-39d5-40b7-beb6-13e4c98ff9ee tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.983223 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0456c471-39d5-40b7-beb6-13e4c98ff9ee tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:22.983674 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0456c471-39d5-40b7-beb6-13e4c98ff9ee tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:22.984090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0456c471-39d5-40b7-beb6-13e4c98ff9ee tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.998534 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-0456c471-39d5-40b7-beb6-13e4c98ff9ee tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] HTTP exception thrown: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0456c471-39d5-40b7-beb6-13e4c98ff9ee tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Request method failure captured: Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 HTTP/1.1 Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZbWDX1OExU8MlqW5YX86Tdq7I_20Ldar_4EDDzpCsfIwyhuCautrFs7M-qqtXbD68S6nSAJeIHLI8K6ik_tBybZWq8DNnSSUBPUuor9QK7cgcwJq4Q0-2eBqC-dlr8xP85BWRDY5wfSmdtMmYLPchphtBV1ctUB09aal12ZFbbkEo Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: 43d4440dd2464bcb95e25ead37c5658a Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-985884000 Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:06:23.000061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:06:23.001530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:06:23.001530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-985884000 Sep 17 21:06:23.001530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 43d4440dd2464bcb95e25ead37c5658a Sep 17 21:06:23.001530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-985884000 Sep 17 21:06:23.001530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-985884000-project Sep 17 21:06:23.001530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:06:23.001530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:06:23.001530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 1fa4420540af41e4967b0f731f818af5 Sep 17 21:06:23.001530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-985884000-project Sep 17 21:06:23.001530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:06:23.001530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:23.001530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '43d0d277-2981-45b9-88e1-1d9dd5aaaff5'} Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:23.002357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:23.003702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:06:23.005648 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0456c471-39d5-40b7-beb6-13e4c98ff9ee tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Returning 404 to user: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:23.005648 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0456c471-39d5-40b7-beb6-13e4c98ff9ee tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 404 len: 111 microversion: 2.1 time: 0.031983 Sep 17 21:06:23.005648 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 176/338] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:06:22 2022] DELETE /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:23.010262 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdd05b26-99ae-4355-a62c-7dfce8f22707 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:23.010886 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cdd05b26-99ae-4355-a62c-7dfce8f22707 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] [instance: 43d0d277-2981-45b9-88e1-1d9dd5aaaff5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:23.017240 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdd05b26-99ae-4355-a62c-7dfce8f22707 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:23.017711 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdd05b26-99ae-4355-a62c-7dfce8f22707 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:23.018135 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdd05b26-99ae-4355-a62c-7dfce8f22707 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:23.018835 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdd05b26-99ae-4355-a62c-7dfce8f22707 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:23.019281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdd05b26-99ae-4355-a62c-7dfce8f22707 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:23.019701 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdd05b26-99ae-4355-a62c-7dfce8f22707 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:23.033092 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-cdd05b26-99ae-4355-a62c-7dfce8f22707 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] HTTP exception thrown: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdd05b26-99ae-4355-a62c-7dfce8f22707 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Request method failure captured: Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 HTTP/1.1 Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZbWDX1OExU8MlqW5YX86Tdq7I_20Ldar_4EDDzpCsfIwyhuCautrFs7M-qqtXbD68S6nSAJeIHLI8K6ik_tBybZWq8DNnSSUBPUuor9QK7cgcwJq4Q0-2eBqC-dlr8xP85BWRDY5wfSmdtMmYLPchphtBV1ctUB09aal12ZFbbkEo Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: 43d4440dd2464bcb95e25ead37c5658a Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-985884000 Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:06:23.035182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:06:23.036570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43d4440dd2464bcb95e25ead37c5658a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:06:23.036570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-985884000 Sep 17 21:06:23.036570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 43d4440dd2464bcb95e25ead37c5658a Sep 17 21:06:23.036570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-985884000 Sep 17 21:06:23.036570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-985884000-project Sep 17 21:06:23.036570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:06:23.036570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:06:23.036570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1fa4420540af41e4967b0f731f818af5 Sep 17 21:06:23.036570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-985884000-project Sep 17 21:06:23.036570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:06:23.036570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:23.036570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '43d0d277-2981-45b9-88e1-1d9dd5aaaff5'} Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:23.037410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. Sep 17 21:06:23.039217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:06:23.040373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdd05b26-99ae-4355-a62c-7dfce8f22707 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] Returning 404 to user: Instance 43d0d277-2981-45b9-88e1-1d9dd5aaaff5 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:23.040373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cdd05b26-99ae-4355-a62c-7dfce8f22707 tempest-DeleteServersTestJSON-985884000 tempest-DeleteServersTestJSON-985884000-project] 10.222.0.16 "GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5" status: 404 len: 111 microversion: 2.1 time: 0.030067 Sep 17 21:06:23.040373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 163/339] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:23 2022] GET /compute/v2.1/servers/43d0d277-2981-45b9-88e1-1d9dd5aaaff5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:23.159985 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23850575-3679-487a-b2a2-16279146a3d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:23.160598 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23850575-3679-487a-b2a2-16279146a3d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:23.167306 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23850575-3679-487a-b2a2-16279146a3d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:23.167854 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23850575-3679-487a-b2a2-16279146a3d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:23.168404 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23850575-3679-487a-b2a2-16279146a3d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:23.169133 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23850575-3679-487a-b2a2-16279146a3d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:23.169718 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23850575-3679-487a-b2a2-16279146a3d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:23.170142 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23850575-3679-487a-b2a2-16279146a3d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:23.406343 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-23850575-3679-487a-b2a2-16279146a3d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:23.416872 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23850575-3679-487a-b2a2-16279146a3d6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.261123 Sep 17 21:06:23.417921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 177/340] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:23 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:24.441649 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cd81ec1b-8e38-4886-b843-dfde75cbec87 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:24.442292 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cd81ec1b-8e38-4886-b843-dfde75cbec87 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:24.449938 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd81ec1b-8e38-4886-b843-dfde75cbec87 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:24.450427 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd81ec1b-8e38-4886-b843-dfde75cbec87 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:24.450857 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd81ec1b-8e38-4886-b843-dfde75cbec87 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:24.451571 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd81ec1b-8e38-4886-b843-dfde75cbec87 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:24.452025 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd81ec1b-8e38-4886-b843-dfde75cbec87 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:24.452446 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd81ec1b-8e38-4886-b843-dfde75cbec87 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:24.729380 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cd81ec1b-8e38-4886-b843-dfde75cbec87 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:24.737359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cd81ec1b-8e38-4886-b843-dfde75cbec87 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.299676 Sep 17 21:06:24.737910 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 164/341] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:24 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:25.761187 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7b4277a-493e-4880-b1dc-e3380ab555f6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:25.761924 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a7b4277a-493e-4880-b1dc-e3380ab555f6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:25.774510 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7b4277a-493e-4880-b1dc-e3380ab555f6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:25.775270 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7b4277a-493e-4880-b1dc-e3380ab555f6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:25.775797 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7b4277a-493e-4880-b1dc-e3380ab555f6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:25.776822 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7b4277a-493e-4880-b1dc-e3380ab555f6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:25.777513 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7b4277a-493e-4880-b1dc-e3380ab555f6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:25.777997 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7b4277a-493e-4880-b1dc-e3380ab555f6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:25.965057 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a7b4277a-493e-4880-b1dc-e3380ab555f6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:25.979361 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a7b4277a-493e-4880-b1dc-e3380ab555f6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.221848 Sep 17 21:06:25.980498 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 178/342] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:25 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:27.003343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-80c0ba55-2e4c-445e-a954-9547eb0bf931 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:27.004082 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-80c0ba55-2e4c-445e-a954-9547eb0bf931 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:27.012447 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80c0ba55-2e4c-445e-a954-9547eb0bf931 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.013186 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80c0ba55-2e4c-445e-a954-9547eb0bf931 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.013731 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80c0ba55-2e4c-445e-a954-9547eb0bf931 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.014527 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80c0ba55-2e4c-445e-a954-9547eb0bf931 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.015358 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80c0ba55-2e4c-445e-a954-9547eb0bf931 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.015847 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80c0ba55-2e4c-445e-a954-9547eb0bf931 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.188457 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-80c0ba55-2e4c-445e-a954-9547eb0bf931 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:27.198835 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-80c0ba55-2e4c-445e-a954-9547eb0bf931 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.199758 Sep 17 21:06:27.199624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 165/343] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:26 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:28.225065 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-18e43a97-c6d8-45fc-9b2b-bc91c0d30d08 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:28.226717 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-18e43a97-c6d8-45fc-9b2b-bc91c0d30d08 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:28.241070 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18e43a97-c6d8-45fc-9b2b-bc91c0d30d08 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:28.241363 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18e43a97-c6d8-45fc-9b2b-bc91c0d30d08 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:28.242040 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18e43a97-c6d8-45fc-9b2b-bc91c0d30d08 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:28.243136 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18e43a97-c6d8-45fc-9b2b-bc91c0d30d08 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:28.243712 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18e43a97-c6d8-45fc-9b2b-bc91c0d30d08 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:28.244138 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18e43a97-c6d8-45fc-9b2b-bc91c0d30d08 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:28.453893 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-18e43a97-c6d8-45fc-9b2b-bc91c0d30d08 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:28.464297 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-18e43a97-c6d8-45fc-9b2b-bc91c0d30d08 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.244631 Sep 17 21:06:28.465196 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 179/344] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:28 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:29.488937 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1cb9ae4f-830a-47fc-934b-60f70dd3edd2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:29.490612 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1cb9ae4f-830a-47fc-934b-60f70dd3edd2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:29.497829 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cb9ae4f-830a-47fc-934b-60f70dd3edd2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:29.498475 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cb9ae4f-830a-47fc-934b-60f70dd3edd2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:29.498981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cb9ae4f-830a-47fc-934b-60f70dd3edd2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:29.499758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cb9ae4f-830a-47fc-934b-60f70dd3edd2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:29.500289 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cb9ae4f-830a-47fc-934b-60f70dd3edd2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:29.500936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cb9ae4f-830a-47fc-934b-60f70dd3edd2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:29.638523 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1cb9ae4f-830a-47fc-934b-60f70dd3edd2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:29.647566 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1cb9ae4f-830a-47fc-934b-60f70dd3edd2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.162489 Sep 17 21:06:29.648527 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 166/345] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:29 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:30.670923 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05bb5c9a-4957-4794-bdb9-999e83f77323 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:30.671716 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-05bb5c9a-4957-4794-bdb9-999e83f77323 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:30.678466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05bb5c9a-4957-4794-bdb9-999e83f77323 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.679687 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05bb5c9a-4957-4794-bdb9-999e83f77323 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.680223 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05bb5c9a-4957-4794-bdb9-999e83f77323 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.681193 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05bb5c9a-4957-4794-bdb9-999e83f77323 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.681774 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05bb5c9a-4957-4794-bdb9-999e83f77323 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.682504 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05bb5c9a-4957-4794-bdb9-999e83f77323 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.922326 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-05bb5c9a-4957-4794-bdb9-999e83f77323 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:30.933588 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-05bb5c9a-4957-4794-bdb9-999e83f77323 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.266285 Sep 17 21:06:30.934688 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 180/346] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:30 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:31.959527 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64b1cb58-cf16-41c9-b978-ea9ae5554742 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:31.961499 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64b1cb58-cf16-41c9-b978-ea9ae5554742 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:31.976844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b1cb58-cf16-41c9-b978-ea9ae5554742 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.978034 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b1cb58-cf16-41c9-b978-ea9ae5554742 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.978752 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b1cb58-cf16-41c9-b978-ea9ae5554742 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.980189 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b1cb58-cf16-41c9-b978-ea9ae5554742 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.980932 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b1cb58-cf16-41c9-b978-ea9ae5554742 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.981763 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b1cb58-cf16-41c9-b978-ea9ae5554742 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:32.203128 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-64b1cb58-cf16-41c9-b978-ea9ae5554742 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:32.216816 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64b1cb58-cf16-41c9-b978-ea9ae5554742 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.261849 Sep 17 21:06:32.217989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 167/347] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:31 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:32.664690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-847da269-99c2-4e83-8eb6-ae8ae9df9a14 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Action: 'create', calling method: .version_select at 0x7f9ba7629670>, body: {"keypair": {"name": "tempest-keypair-1378285587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgvtLOBu4OHkg74rcsJXf+d+QWjoY07l0JjZ6A4cVbkNRgQy2deHy+oApMasIYaNuiz9+aGEa+X9aboRU7wgYvf29PFObsO7OaCRFx5ORux67f9+nA2XryqSXI7l57ZdQ=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:32.680842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-847da269-99c2-4e83-8eb6-ae8ae9df9a14 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Getting quotas for project c1913d0c899c48ab9a7781a9e45ac4a9. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:06:32.684641 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-847da269-99c2-4e83-8eb6-ae8ae9df9a14 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Getting quotas for user 1dc5f1d34cad437ea15efb98a0a1ca31 and project c1913d0c899c48ab9a7781a9e45ac4a9. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:06:32.707253 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-847da269-99c2-4e83-8eb6-ae8ae9df9a14 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.161938 Sep 17 21:06:32.707935 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 181/348] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Sep 17 21:06:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 17 21:06:33.241580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f376608-c7b4-4854-85c1-c1d0c6cf10ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:33.243119 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f376608-c7b4-4854-85c1-c1d0c6cf10ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:33.249814 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f376608-c7b4-4854-85c1-c1d0c6cf10ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:33.250302 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f376608-c7b4-4854-85c1-c1d0c6cf10ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:33.250734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f376608-c7b4-4854-85c1-c1d0c6cf10ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:33.251440 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f376608-c7b4-4854-85c1-c1d0c6cf10ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:33.251890 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f376608-c7b4-4854-85c1-c1d0c6cf10ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:33.252313 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f376608-c7b4-4854-85c1-c1d0c6cf10ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:33.407543 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8f376608-c7b4-4854-85c1-c1d0c6cf10ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:33.417072 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8f376608-c7b4-4854-85c1-c1d0c6cf10ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.180059 Sep 17 21:06:33.418113 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 168/349] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:33 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:34.301603 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-77289308", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c55663b-3b93-47c5-8d74-f84d3023d441"}], "security_groups": [{"name": "tempest-securitygroup--1077874764"}], "key_name": "tempest-keypair-1378285587", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:34.408882 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] validate_networks() for [('5c55663b-3b93-47c5-8d74-f84d3023d441', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:06:34.439384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-85c635c1-fa57-4fad-bf93-501021c0d2b7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:34.440017 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-85c635c1-fa57-4fad-bf93-501021c0d2b7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:34.448265 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85c635c1-fa57-4fad-bf93-501021c0d2b7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:34.448784 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85c635c1-fa57-4fad-bf93-501021c0d2b7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:34.449222 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85c635c1-fa57-4fad-bf93-501021c0d2b7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:34.449919 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85c635c1-fa57-4fad-bf93-501021c0d2b7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:34.450374 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85c635c1-fa57-4fad-bf93-501021c0d2b7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:34.450795 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85c635c1-fa57-4fad-bf93-501021c0d2b7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:34.644151 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-85c635c1-fa57-4fad-bf93-501021c0d2b7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:34.648048 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:34.658779 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-85c635c1-fa57-4fad-bf93-501021c0d2b7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.223183 Sep 17 21:06:34.659372 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 169/350] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:34 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:34.852464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:06:34.852960 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:06:34.853438 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:06:34.854028 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:06:34.854448 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:06:34.863544 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:34.864328 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:34.864883 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:34.865625 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:34.866086 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:34.866513 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:34.884031 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Getting quotas for project c1913d0c899c48ab9a7781a9e45ac4a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:06:34.888546 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Getting quotas for user 1dc5f1d34cad437ea15efb98a0a1ca31 and project c1913d0c899c48ab9a7781a9e45ac4a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:06:34.900583 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:06:34.902938 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:06:34.951986 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-83981219-b052-4fb1-9a52-6a193ec34634 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.654822 Sep 17 21:06:34.952866 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 182/351] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 17 21:06:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 21:06:34.964894 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-01be4e6e-04a2-4a49-a345-4b7d5f0f5360 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:34.965503 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-01be4e6e-04a2-4a49-a345-4b7d5f0f5360 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:35.026417 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-01be4e6e-04a2-4a49-a345-4b7d5f0f5360 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:35.034662 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-01be4e6e-04a2-4a49-a345-4b7d5f0f5360 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:35.036181 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-01be4e6e-04a2-4a49-a345-4b7d5f0f5360 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:35.037300 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01be4e6e-04a2-4a49-a345-4b7d5f0f5360 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1280 microversion: 2.20 time: 0.076351 Sep 17 21:06:35.037840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 170/352] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:34 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:35.681606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f54fb9b-966d-4b5d-af73-06a2f5feaffc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:35.682217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f54fb9b-966d-4b5d-af73-06a2f5feaffc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:35.689325 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f54fb9b-966d-4b5d-af73-06a2f5feaffc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:35.689947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f54fb9b-966d-4b5d-af73-06a2f5feaffc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:35.690450 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f54fb9b-966d-4b5d-af73-06a2f5feaffc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:35.691225 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f54fb9b-966d-4b5d-af73-06a2f5feaffc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:35.691777 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f54fb9b-966d-4b5d-af73-06a2f5feaffc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:35.692823 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f54fb9b-966d-4b5d-af73-06a2f5feaffc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:35.880036 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f54fb9b-966d-4b5d-af73-06a2f5feaffc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:35.890319 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f54fb9b-966d-4b5d-af73-06a2f5feaffc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.212620 Sep 17 21:06:35.896752 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 183/353] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:35 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:36.061513 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d16516b8-0f00-4748-97c4-6d54beb1f81e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:36.062714 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d16516b8-0f00-4748-97c4-6d54beb1f81e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:36.071883 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d16516b8-0f00-4748-97c4-6d54beb1f81e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:36.073563 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d16516b8-0f00-4748-97c4-6d54beb1f81e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:36.078853 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d16516b8-0f00-4748-97c4-6d54beb1f81e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:36.080137 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d16516b8-0f00-4748-97c4-6d54beb1f81e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:36.080889 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d16516b8-0f00-4748-97c4-6d54beb1f81e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:36.081548 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d16516b8-0f00-4748-97c4-6d54beb1f81e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:36.167094 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d16516b8-0f00-4748-97c4-6d54beb1f81e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:36.176576 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d16516b8-0f00-4748-97c4-6d54beb1f81e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:36.178114 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d16516b8-0f00-4748-97c4-6d54beb1f81e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:36.180421 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d16516b8-0f00-4748-97c4-6d54beb1f81e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1332 microversion: 2.20 time: 0.122686 Sep 17 21:06:36.182638 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 171/354] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:36 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1332 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:36.918461 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3022f570-eb30-44be-9435-94764c45a7a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:36.918942 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3022f570-eb30-44be-9435-94764c45a7a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:36.924620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3022f570-eb30-44be-9435-94764c45a7a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:36.925158 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3022f570-eb30-44be-9435-94764c45a7a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:36.925595 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3022f570-eb30-44be-9435-94764c45a7a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:36.926398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3022f570-eb30-44be-9435-94764c45a7a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:36.926933 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3022f570-eb30-44be-9435-94764c45a7a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:36.927441 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3022f570-eb30-44be-9435-94764c45a7a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:37.138255 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3022f570-eb30-44be-9435-94764c45a7a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:37.146714 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3022f570-eb30-44be-9435-94764c45a7a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.233291 Sep 17 21:06:37.147278 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 184/355] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:36 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:37.207036 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-370d6ab1-e9b4-400a-8d7b-1577a660a1fa tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:37.208325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-370d6ab1-e9b4-400a-8d7b-1577a660a1fa tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:37.216297 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-370d6ab1-e9b4-400a-8d7b-1577a660a1fa tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:37.217112 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-370d6ab1-e9b4-400a-8d7b-1577a660a1fa tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:37.217565 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-370d6ab1-e9b4-400a-8d7b-1577a660a1fa tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:37.218280 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-370d6ab1-e9b4-400a-8d7b-1577a660a1fa tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:37.218750 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-370d6ab1-e9b4-400a-8d7b-1577a660a1fa tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:37.219632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-370d6ab1-e9b4-400a-8d7b-1577a660a1fa tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:37.288632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-370d6ab1-e9b4-400a-8d7b-1577a660a1fa tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:37.296827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-370d6ab1-e9b4-400a-8d7b-1577a660a1fa tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:37.298276 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-370d6ab1-e9b4-400a-8d7b-1577a660a1fa tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:37.299362 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-370d6ab1-e9b4-400a-8d7b-1577a660a1fa tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1338 microversion: 2.20 time: 0.097291 Sep 17 21:06:37.299917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 172/356] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:37 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:38.072143 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8080b8a9-103e-4235-b8fe-b8affe1c134d req-03781ac5-7453-43bd-b8f9-553a8ab60eda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785212fb-7493-49ce-b3f0-12b3742b3a88", "tag": "3a9a1b04-a0c4-4a66-a693-a268f50c530b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:38.081402 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8080b8a9-103e-4235-b8fe-b8affe1c134d req-03781ac5-7453-43bd-b8f9-553a8ab60eda service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:38.081877 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8080b8a9-103e-4235-b8fe-b8affe1c134d req-03781ac5-7453-43bd-b8f9-553a8ab60eda service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:38.082304 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8080b8a9-103e-4235-b8fe-b8affe1c134d req-03781ac5-7453-43bd-b8f9-553a8ab60eda service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:38.093705 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8080b8a9-103e-4235-b8fe-b8affe1c134d req-03781ac5-7453-43bd-b8f9-553a8ab60eda service nova] Creating event network-changed:3a9a1b04-a0c4-4a66-a693-a268f50c530b for instance 785212fb-7493-49ce-b3f0-12b3742b3a88 on hv-cinder-82651 Sep 17 21:06:38.099348 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8080b8a9-103e-4235-b8fe-b8affe1c134d req-03781ac5-7453-43bd-b8f9-553a8ab60eda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030401 Sep 17 21:06:38.101433 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 185/357] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:38.169393 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-749889ad-a97d-4a93-a5e8-f57f23e43137 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:38.170030 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-749889ad-a97d-4a93-a5e8-f57f23e43137 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:38.175950 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749889ad-a97d-4a93-a5e8-f57f23e43137 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:38.176519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749889ad-a97d-4a93-a5e8-f57f23e43137 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:38.176997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749889ad-a97d-4a93-a5e8-f57f23e43137 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:38.177683 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749889ad-a97d-4a93-a5e8-f57f23e43137 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:38.178134 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749889ad-a97d-4a93-a5e8-f57f23e43137 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:38.178555 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749889ad-a97d-4a93-a5e8-f57f23e43137 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:38.308553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-749889ad-a97d-4a93-a5e8-f57f23e43137 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:38.316109 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-749889ad-a97d-4a93-a5e8-f57f23e43137 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.150547 Sep 17 21:06:38.316665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 173/358] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:38 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:38.326293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eb40bfa9-87eb-433d-a457-1703640f9b90 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:38.327014 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eb40bfa9-87eb-433d-a457-1703640f9b90 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:38.333697 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb40bfa9-87eb-433d-a457-1703640f9b90 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:38.334174 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb40bfa9-87eb-433d-a457-1703640f9b90 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:38.334607 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb40bfa9-87eb-433d-a457-1703640f9b90 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:38.335293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb40bfa9-87eb-433d-a457-1703640f9b90 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:38.335742 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb40bfa9-87eb-433d-a457-1703640f9b90 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:38.336159 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb40bfa9-87eb-433d-a457-1703640f9b90 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:38.461375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-eb40bfa9-87eb-433d-a457-1703640f9b90 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:38.469471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-eb40bfa9-87eb-433d-a457-1703640f9b90 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:38.470919 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-eb40bfa9-87eb-433d-a457-1703640f9b90 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:38.472019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eb40bfa9-87eb-433d-a457-1703640f9b90 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.150016 Sep 17 21:06:38.472571 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 186/359] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:38 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:39.339208 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2f9097e-a170-46c4-9682-9476b50d9bb9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:39.339819 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b2f9097e-a170-46c4-9682-9476b50d9bb9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:39.346349 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2f9097e-a170-46c4-9682-9476b50d9bb9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:39.346827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2f9097e-a170-46c4-9682-9476b50d9bb9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:39.347279 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2f9097e-a170-46c4-9682-9476b50d9bb9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:39.347964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2f9097e-a170-46c4-9682-9476b50d9bb9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:39.349067 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2f9097e-a170-46c4-9682-9476b50d9bb9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:39.349486 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2f9097e-a170-46c4-9682-9476b50d9bb9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:39.498226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29109b34-67da-48a9-a3c5-bb2c05db4076 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:39.498835 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29109b34-67da-48a9-a3c5-bb2c05db4076 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:39.505367 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29109b34-67da-48a9-a3c5-bb2c05db4076 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:39.505926 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29109b34-67da-48a9-a3c5-bb2c05db4076 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:39.506368 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29109b34-67da-48a9-a3c5-bb2c05db4076 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:39.507069 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29109b34-67da-48a9-a3c5-bb2c05db4076 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:39.507528 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29109b34-67da-48a9-a3c5-bb2c05db4076 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:39.507992 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29109b34-67da-48a9-a3c5-bb2c05db4076 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:39.662813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2f9097e-a170-46c4-9682-9476b50d9bb9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:39.670473 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b2f9097e-a170-46c4-9682-9476b50d9bb9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.335105 Sep 17 21:06:39.671026 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 174/360] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:39 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:39.685492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-29109b34-67da-48a9-a3c5-bb2c05db4076 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:39.693583 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-29109b34-67da-48a9-a3c5-bb2c05db4076 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:39.695006 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-29109b34-67da-48a9-a3c5-bb2c05db4076 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:39.696348 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29109b34-67da-48a9-a3c5-bb2c05db4076 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.202133 Sep 17 21:06:39.696930 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 187/361] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:39 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:06:40.693153 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ac4c127-c1ea-4932-873d-e61bc31859ca tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:40.693762 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2ac4c127-c1ea-4932-873d-e61bc31859ca tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:40.700341 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac4c127-c1ea-4932-873d-e61bc31859ca tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:40.700852 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac4c127-c1ea-4932-873d-e61bc31859ca tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:40.701313 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac4c127-c1ea-4932-873d-e61bc31859ca tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:40.701992 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac4c127-c1ea-4932-873d-e61bc31859ca tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:40.702438 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac4c127-c1ea-4932-873d-e61bc31859ca tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:40.702855 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac4c127-c1ea-4932-873d-e61bc31859ca tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:40.721368 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cb576747-3282-4047-97ff-8ab2224562ea tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:40.721975 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cb576747-3282-4047-97ff-8ab2224562ea tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:40.728371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb576747-3282-4047-97ff-8ab2224562ea tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:40.728937 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb576747-3282-4047-97ff-8ab2224562ea tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:40.729374 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb576747-3282-4047-97ff-8ab2224562ea tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:40.730070 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb576747-3282-4047-97ff-8ab2224562ea tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:40.730524 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb576747-3282-4047-97ff-8ab2224562ea tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:40.730947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb576747-3282-4047-97ff-8ab2224562ea tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:40.884871 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ac4c127-c1ea-4932-873d-e61bc31859ca tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:40.892462 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ac4c127-c1ea-4932-873d-e61bc31859ca tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.203278 Sep 17 21:06:40.894038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 175/362] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:40 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:40.905864 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cb576747-3282-4047-97ff-8ab2224562ea tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:40.914216 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cb576747-3282-4047-97ff-8ab2224562ea tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:40.915654 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cb576747-3282-4047-97ff-8ab2224562ea tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:40.916786 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cb576747-3282-4047-97ff-8ab2224562ea tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.199340 Sep 17 21:06:40.917330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 188/363] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:40 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:06:41.917693 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-78deb830-beb6-4d89-902d-1852cf209d23 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:41.918221 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-78deb830-beb6-4d89-902d-1852cf209d23 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:41.924989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78deb830-beb6-4d89-902d-1852cf209d23 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:41.925475 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78deb830-beb6-4d89-902d-1852cf209d23 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:41.925905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78deb830-beb6-4d89-902d-1852cf209d23 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:41.926605 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78deb830-beb6-4d89-902d-1852cf209d23 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:41.927058 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78deb830-beb6-4d89-902d-1852cf209d23 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:41.927475 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78deb830-beb6-4d89-902d-1852cf209d23 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:41.942944 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-370b5250-4a6c-4f24-b947-d5083760f828 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:41.943694 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-370b5250-4a6c-4f24-b947-d5083760f828 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:41.950224 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-370b5250-4a6c-4f24-b947-d5083760f828 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:41.950777 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-370b5250-4a6c-4f24-b947-d5083760f828 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:41.951274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-370b5250-4a6c-4f24-b947-d5083760f828 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:41.952038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-370b5250-4a6c-4f24-b947-d5083760f828 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:41.952559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-370b5250-4a6c-4f24-b947-d5083760f828 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:41.953093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-370b5250-4a6c-4f24-b947-d5083760f828 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:42.209314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-78deb830-beb6-4d89-902d-1852cf209d23 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:42.217775 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-78deb830-beb6-4d89-902d-1852cf209d23 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.304014 Sep 17 21:06:42.218543 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 176/364] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:41 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:42.250670 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-370b5250-4a6c-4f24-b947-d5083760f828 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:42.259217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-370b5250-4a6c-4f24-b947-d5083760f828 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:42.260695 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-370b5250-4a6c-4f24-b947-d5083760f828 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:42.261791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-370b5250-4a6c-4f24-b947-d5083760f828 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.324189 Sep 17 21:06:42.262630 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 189/365] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:41 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:06:43.241099 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-320057dd-1441-4a50-89b3-3d1ec8a9975e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:43.241709 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-320057dd-1441-4a50-89b3-3d1ec8a9975e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:43.247945 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-320057dd-1441-4a50-89b3-3d1ec8a9975e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.248419 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-320057dd-1441-4a50-89b3-3d1ec8a9975e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.248889 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-320057dd-1441-4a50-89b3-3d1ec8a9975e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.249569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-320057dd-1441-4a50-89b3-3d1ec8a9975e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.250019 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-320057dd-1441-4a50-89b3-3d1ec8a9975e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.250437 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-320057dd-1441-4a50-89b3-3d1ec8a9975e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.287183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9071d225-be16-4458-841d-cdad7b70f32a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:43.287809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9071d225-be16-4458-841d-cdad7b70f32a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:43.293797 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9071d225-be16-4458-841d-cdad7b70f32a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.294277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9071d225-be16-4458-841d-cdad7b70f32a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.294706 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9071d225-be16-4458-841d-cdad7b70f32a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.295397 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9071d225-be16-4458-841d-cdad7b70f32a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.295875 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9071d225-be16-4458-841d-cdad7b70f32a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.296292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9071d225-be16-4458-841d-cdad7b70f32a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.654923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-320057dd-1441-4a50-89b3-3d1ec8a9975e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:43.663487 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-320057dd-1441-4a50-89b3-3d1ec8a9975e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.426466 Sep 17 21:06:43.664049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 177/366] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:43 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:43.678138 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9071d225-be16-4458-841d-cdad7b70f32a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:43.686125 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9071d225-be16-4458-841d-cdad7b70f32a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:43.687559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9071d225-be16-4458-841d-cdad7b70f32a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:43.688658 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9071d225-be16-4458-841d-cdad7b70f32a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.405323 Sep 17 21:06:43.689226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 190/367] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:43 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:06:44.687716 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9bf25911-cad4-42d5-881b-bb87688286d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:44.688517 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9bf25911-cad4-42d5-881b-bb87688286d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:44.702183 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bf25911-cad4-42d5-881b-bb87688286d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:44.702677 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bf25911-cad4-42d5-881b-bb87688286d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:44.703115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bf25911-cad4-42d5-881b-bb87688286d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:44.703850 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bf25911-cad4-42d5-881b-bb87688286d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:44.704316 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bf25911-cad4-42d5-881b-bb87688286d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:44.704848 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bf25911-cad4-42d5-881b-bb87688286d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:44.718732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-36cef40f-1619-4fba-8e38-ca9f1e90018f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:44.719533 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-36cef40f-1619-4fba-8e38-ca9f1e90018f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:44.735730 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36cef40f-1619-4fba-8e38-ca9f1e90018f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:44.736240 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36cef40f-1619-4fba-8e38-ca9f1e90018f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:44.736723 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36cef40f-1619-4fba-8e38-ca9f1e90018f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:44.740277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36cef40f-1619-4fba-8e38-ca9f1e90018f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:44.740860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36cef40f-1619-4fba-8e38-ca9f1e90018f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:44.741306 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36cef40f-1619-4fba-8e38-ca9f1e90018f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:44.874741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:44.895943 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:44.993616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9bf25911-cad4-42d5-881b-bb87688286d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:45.009499 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9bf25911-cad4-42d5-881b-bb87688286d9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.326590 Sep 17 21:06:45.030990 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 178/368] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:44 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:45.038186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-36cef40f-1619-4fba-8e38-ca9f1e90018f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:45.051188 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-36cef40f-1619-4fba-8e38-ca9f1e90018f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:45.053641 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-36cef40f-1619-4fba-8e38-ca9f1e90018f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:45.055131 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-36cef40f-1619-4fba-8e38-ca9f1e90018f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.341375 Sep 17 21:06:45.056643 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 191/369] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:44 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:46.033969 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b8a46b9c-651b-4b5f-8754-d683c267c3dc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:46.034570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b8a46b9c-651b-4b5f-8754-d683c267c3dc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:46.037931 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:46.042149 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8a46b9c-651b-4b5f-8754-d683c267c3dc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:46.042774 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8a46b9c-651b-4b5f-8754-d683c267c3dc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:46.043119 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8a46b9c-651b-4b5f-8754-d683c267c3dc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:46.043749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8a46b9c-651b-4b5f-8754-d683c267c3dc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:46.044201 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8a46b9c-651b-4b5f-8754-d683c267c3dc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:46.044660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8a46b9c-651b-4b5f-8754-d683c267c3dc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:46.079386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-18419ced-7619-425e-9d07-da6d69c67a52 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:46.079990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-18419ced-7619-425e-9d07-da6d69c67a52 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:46.101395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18419ced-7619-425e-9d07-da6d69c67a52 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:46.101893 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18419ced-7619-425e-9d07-da6d69c67a52 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:46.102333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18419ced-7619-425e-9d07-da6d69c67a52 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:46.103039 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18419ced-7619-425e-9d07-da6d69c67a52 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:46.103493 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18419ced-7619-425e-9d07-da6d69c67a52 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:46.103914 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18419ced-7619-425e-9d07-da6d69c67a52 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:46.258205 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b8a46b9c-651b-4b5f-8754-d683c267c3dc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:46.265954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b8a46b9c-651b-4b5f-8754-d683c267c3dc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.236415 Sep 17 21:06:46.266500 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 179/370] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:46 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:46.293021 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-18419ced-7619-425e-9d07-da6d69c67a52 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:46.301335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-18419ced-7619-425e-9d07-da6d69c67a52 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:46.302866 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-18419ced-7619-425e-9d07-da6d69c67a52 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:46.304076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-18419ced-7619-425e-9d07-da6d69c67a52 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.228473 Sep 17 21:06:46.304734 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 192/371] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:46 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:47.290218 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aba01d7d-1f1e-474a-8c70-44a07175602b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:47.290674 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aba01d7d-1f1e-474a-8c70-44a07175602b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:47.297078 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aba01d7d-1f1e-474a-8c70-44a07175602b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.297559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aba01d7d-1f1e-474a-8c70-44a07175602b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.297987 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aba01d7d-1f1e-474a-8c70-44a07175602b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.298675 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aba01d7d-1f1e-474a-8c70-44a07175602b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.299133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aba01d7d-1f1e-474a-8c70-44a07175602b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.299628 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aba01d7d-1f1e-474a-8c70-44a07175602b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.330133 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e5909b6-bce1-4400-acdf-5d086c2d42eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:47.331050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7e5909b6-bce1-4400-acdf-5d086c2d42eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:47.340291 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e5909b6-bce1-4400-acdf-5d086c2d42eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.340291 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e5909b6-bce1-4400-acdf-5d086c2d42eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.340291 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e5909b6-bce1-4400-acdf-5d086c2d42eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.340965 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e5909b6-bce1-4400-acdf-5d086c2d42eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.341559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e5909b6-bce1-4400-acdf-5d086c2d42eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.342078 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e5909b6-bce1-4400-acdf-5d086c2d42eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.366919 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:47.534572 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-aba01d7d-1f1e-474a-8c70-44a07175602b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:47.544936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aba01d7d-1f1e-474a-8c70-44a07175602b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.259921 Sep 17 21:06:47.547113 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 180/372] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:47 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:47.573772 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7e5909b6-bce1-4400-acdf-5d086c2d42eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:47.585615 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7e5909b6-bce1-4400-acdf-5d086c2d42eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:47.587262 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7e5909b6-bce1-4400-acdf-5d086c2d42eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:47.588646 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e5909b6-bce1-4400-acdf-5d086c2d42eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.262585 Sep 17 21:06:47.589709 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 193/373] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:47 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:06:48.575629 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b55dbba7-a228-4d87-be4e-1c8249ef7ee2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:48.576228 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b55dbba7-a228-4d87-be4e-1c8249ef7ee2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:48.582695 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b55dbba7-a228-4d87-be4e-1c8249ef7ee2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.583169 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b55dbba7-a228-4d87-be4e-1c8249ef7ee2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.583664 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b55dbba7-a228-4d87-be4e-1c8249ef7ee2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.584351 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b55dbba7-a228-4d87-be4e-1c8249ef7ee2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.584891 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b55dbba7-a228-4d87-be4e-1c8249ef7ee2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.585378 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b55dbba7-a228-4d87-be4e-1c8249ef7ee2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.618567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c6566c30-c621-42c8-b855-f254df6024b3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:48.619336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c6566c30-c621-42c8-b855-f254df6024b3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:48.625329 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6566c30-c621-42c8-b855-f254df6024b3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.625914 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6566c30-c621-42c8-b855-f254df6024b3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.626416 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6566c30-c621-42c8-b855-f254df6024b3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.627211 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6566c30-c621-42c8-b855-f254df6024b3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.627726 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6566c30-c621-42c8-b855-f254df6024b3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.628279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6566c30-c621-42c8-b855-f254df6024b3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.795131 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b55dbba7-a228-4d87-be4e-1c8249ef7ee2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:48.802725 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b55dbba7-a228-4d87-be4e-1c8249ef7ee2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1520 microversion: 2.1 time: 0.230898 Sep 17 21:06:48.803320 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 181/374] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:48 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:48.815875 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6566c30-c621-42c8-b855-f254df6024b3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:48.824166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6566c30-c621-42c8-b855-f254df6024b3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:48.825641 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6566c30-c621-42c8-b855-f254df6024b3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:48.826739 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c6566c30-c621-42c8-b855-f254df6024b3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.212299 Sep 17 21:06:48.827289 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 194/375] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:48 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:06:49.827356 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9f690295-bc99-4b77-9f24-576a4a52c033 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:49.827989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9f690295-bc99-4b77-9f24-576a4a52c033 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:49.830551 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=46 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:49.836366 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f690295-bc99-4b77-9f24-576a4a52c033 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:49.836883 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f690295-bc99-4b77-9f24-576a4a52c033 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:49.837316 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f690295-bc99-4b77-9f24-576a4a52c033 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:49.838047 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f690295-bc99-4b77-9f24-576a4a52c033 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:49.838567 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f690295-bc99-4b77-9f24-576a4a52c033 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:49.838991 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f690295-bc99-4b77-9f24-576a4a52c033 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:49.851663 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0e31c7b-cbea-4582-8ceb-42c597a6af01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:49.852920 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0e31c7b-cbea-4582-8ceb-42c597a6af01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:49.859277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0e31c7b-cbea-4582-8ceb-42c597a6af01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:49.859773 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0e31c7b-cbea-4582-8ceb-42c597a6af01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:49.860208 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0e31c7b-cbea-4582-8ceb-42c597a6af01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:49.861166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0e31c7b-cbea-4582-8ceb-42c597a6af01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:49.861637 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0e31c7b-cbea-4582-8ceb-42c597a6af01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:49.862066 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0e31c7b-cbea-4582-8ceb-42c597a6af01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.036366 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9f690295-bc99-4b77-9f24-576a4a52c033 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:50.052068 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9f690295-bc99-4b77-9f24-576a4a52c033 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1500 microversion: 2.1 time: 0.227777 Sep 17 21:06:50.053518 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 182/376] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:49 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1500 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:50.076124 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fbdcf8ea-ec25-41d2-b752-04dd34804572 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:50.077235 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fbdcf8ea-ec25-41d2-b752-04dd34804572 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:50.081806 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0e31c7b-cbea-4582-8ceb-42c597a6af01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:50.084853 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbdcf8ea-ec25-41d2-b752-04dd34804572 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.085577 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbdcf8ea-ec25-41d2-b752-04dd34804572 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.086190 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbdcf8ea-ec25-41d2-b752-04dd34804572 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.087234 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbdcf8ea-ec25-41d2-b752-04dd34804572 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.087859 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbdcf8ea-ec25-41d2-b752-04dd34804572 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.088465 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbdcf8ea-ec25-41d2-b752-04dd34804572 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.094435 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0e31c7b-cbea-4582-8ceb-42c597a6af01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:50.096192 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0e31c7b-cbea-4582-8ceb-42c597a6af01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:50.097456 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0e31c7b-cbea-4582-8ceb-42c597a6af01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.250003 Sep 17 21:06:50.098675 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 195/377] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:49 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:06:50.231582 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fbdcf8ea-ec25-41d2-b752-04dd34804572 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:50.240224 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fbdcf8ea-ec25-41d2-b752-04dd34804572 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1516 microversion: 2.1 time: 0.168107 Sep 17 21:06:50.240756 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 183/378] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:50 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:51.128896 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2cbeff51-9395-47d7-9e77-46e5550d8b06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:51.129522 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2cbeff51-9395-47d7-9e77-46e5550d8b06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:51.135469 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cbeff51-9395-47d7-9e77-46e5550d8b06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:51.135953 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cbeff51-9395-47d7-9e77-46e5550d8b06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:51.136393 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cbeff51-9395-47d7-9e77-46e5550d8b06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:51.137233 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cbeff51-9395-47d7-9e77-46e5550d8b06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:51.137722 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cbeff51-9395-47d7-9e77-46e5550d8b06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:51.138146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cbeff51-9395-47d7-9e77-46e5550d8b06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:51.267181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2cbeff51-9395-47d7-9e77-46e5550d8b06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:51.275838 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2cbeff51-9395-47d7-9e77-46e5550d8b06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:51.277305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2cbeff51-9395-47d7-9e77-46e5550d8b06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:51.278392 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2cbeff51-9395-47d7-9e77-46e5550d8b06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.153488 Sep 17 21:06:51.278937 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 196/379] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:51 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:52.303167 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8bf4e143-07f0-4349-96e5-9ff6bf8c3e23 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:52.303770 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8bf4e143-07f0-4349-96e5-9ff6bf8c3e23 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:52.310324 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bf4e143-07f0-4349-96e5-9ff6bf8c3e23 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:52.310799 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bf4e143-07f0-4349-96e5-9ff6bf8c3e23 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:52.311231 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bf4e143-07f0-4349-96e5-9ff6bf8c3e23 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:52.311917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bf4e143-07f0-4349-96e5-9ff6bf8c3e23 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:52.312371 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bf4e143-07f0-4349-96e5-9ff6bf8c3e23 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:52.312826 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bf4e143-07f0-4349-96e5-9ff6bf8c3e23 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:52.441863 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8bf4e143-07f0-4349-96e5-9ff6bf8c3e23 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:52.450058 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8bf4e143-07f0-4349-96e5-9ff6bf8c3e23 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:52.451480 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8bf4e143-07f0-4349-96e5-9ff6bf8c3e23 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:52.452568 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8bf4e143-07f0-4349-96e5-9ff6bf8c3e23 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.153537 Sep 17 21:06:52.453144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 184/380] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:52 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:53.478254 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7952754e-e66f-43ce-a098-5515872573d8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:53.478866 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7952754e-e66f-43ce-a098-5515872573d8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:53.480740 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:53.486091 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7952754e-e66f-43ce-a098-5515872573d8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:53.486572 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7952754e-e66f-43ce-a098-5515872573d8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:53.487002 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7952754e-e66f-43ce-a098-5515872573d8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:53.487690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7952754e-e66f-43ce-a098-5515872573d8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:53.488955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7952754e-e66f-43ce-a098-5515872573d8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:53.489557 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7952754e-e66f-43ce-a098-5515872573d8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:53.617761 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7952754e-e66f-43ce-a098-5515872573d8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:53.625423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7952754e-e66f-43ce-a098-5515872573d8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:53.626864 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7952754e-e66f-43ce-a098-5515872573d8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:53.627960 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7952754e-e66f-43ce-a098-5515872573d8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.153586 Sep 17 21:06:53.628505 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 197/381] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:53 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:54.652404 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-86b42f83-31b6-4aac-b07b-d5a8c604c5e4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:54.652948 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-86b42f83-31b6-4aac-b07b-d5a8c604c5e4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:54.659338 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b42f83-31b6-4aac-b07b-d5a8c604c5e4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.659817 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b42f83-31b6-4aac-b07b-d5a8c604c5e4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.660931 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b42f83-31b6-4aac-b07b-d5a8c604c5e4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:54.661700 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b42f83-31b6-4aac-b07b-d5a8c604c5e4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.662157 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b42f83-31b6-4aac-b07b-d5a8c604c5e4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.662577 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b42f83-31b6-4aac-b07b-d5a8c604c5e4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:54.790006 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-86b42f83-31b6-4aac-b07b-d5a8c604c5e4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:54.798180 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-86b42f83-31b6-4aac-b07b-d5a8c604c5e4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:54.799633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-86b42f83-31b6-4aac-b07b-d5a8c604c5e4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:54.801361 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-86b42f83-31b6-4aac-b07b-d5a8c604c5e4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.152295 Sep 17 21:06:54.802214 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 185/382] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:54 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:55.765344 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e88c3ee1-a41d-428a-8fb9-91239b2918be req-14144bb9-5cf9-4351-b5c7-9828cb1dd24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785212fb-7493-49ce-b3f0-12b3742b3a88", "name": "network-vif-plugged", "status": "completed", "tag": "3a9a1b04-a0c4-4a66-a693-a268f50c530b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:55.776899 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e88c3ee1-a41d-428a-8fb9-91239b2918be req-14144bb9-5cf9-4351-b5c7-9828cb1dd24c service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.777523 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e88c3ee1-a41d-428a-8fb9-91239b2918be req-14144bb9-5cf9-4351-b5c7-9828cb1dd24c service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.778112 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e88c3ee1-a41d-428a-8fb9-91239b2918be req-14144bb9-5cf9-4351-b5c7-9828cb1dd24c service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.794030 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e88c3ee1-a41d-428a-8fb9-91239b2918be req-14144bb9-5cf9-4351-b5c7-9828cb1dd24c service nova] Creating event network-vif-plugged:3a9a1b04-a0c4-4a66-a693-a268f50c530b for instance 785212fb-7493-49ce-b3f0-12b3742b3a88 on hv-cinder-82651 Sep 17 21:06:55.800973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e88c3ee1-a41d-428a-8fb9-91239b2918be req-14144bb9-5cf9-4351-b5c7-9828cb1dd24c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038484 Sep 17 21:06:55.802261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 198/383] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:55.834335 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-beb4e026-2892-4a53-aeb1-394c77ec1596 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:55.835680 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-beb4e026-2892-4a53-aeb1-394c77ec1596 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:55.843447 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb4e026-2892-4a53-aeb1-394c77ec1596 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.844165 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb4e026-2892-4a53-aeb1-394c77ec1596 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.844707 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb4e026-2892-4a53-aeb1-394c77ec1596 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.845494 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb4e026-2892-4a53-aeb1-394c77ec1596 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.846021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb4e026-2892-4a53-aeb1-394c77ec1596 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.846580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb4e026-2892-4a53-aeb1-394c77ec1596 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.850013 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fcaafac4-b15e-4d98-bb98-7abbf6ca5fa6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:55.854725 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fcaafac4-b15e-4d98-bb98-7abbf6ca5fa6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:55.865039 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcaafac4-b15e-4d98-bb98-7abbf6ca5fa6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.865803 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcaafac4-b15e-4d98-bb98-7abbf6ca5fa6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.866246 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcaafac4-b15e-4d98-bb98-7abbf6ca5fa6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.867021 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcaafac4-b15e-4d98-bb98-7abbf6ca5fa6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.867524 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcaafac4-b15e-4d98-bb98-7abbf6ca5fa6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.867952 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcaafac4-b15e-4d98-bb98-7abbf6ca5fa6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.897157 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-fcaafac4-b15e-4d98-bb98-7abbf6ca5fa6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lazy-loading 'flavor' on Instance uuid 19898312-d61b-457d-8217-d6c8e2ad2dbc {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:06:55.981244 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fcaafac4-b15e-4d98-bb98-7abbf6ca5fa6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "POST /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc/action" status: 200 len: 32 microversion: 2.1 time: 0.142047 Sep 17 21:06:55.982389 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 199/384] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:55 2022] POST /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:55.993204 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff8ce114-2aa9-471f-98fd-3424c1eb7d2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:55.993909 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ff8ce114-2aa9-471f-98fd-3424c1eb7d2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:56.000454 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff8ce114-2aa9-471f-98fd-3424c1eb7d2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:56.001151 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff8ce114-2aa9-471f-98fd-3424c1eb7d2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:56.001602 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff8ce114-2aa9-471f-98fd-3424c1eb7d2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:56.002870 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff8ce114-2aa9-471f-98fd-3424c1eb7d2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:56.004801 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff8ce114-2aa9-471f-98fd-3424c1eb7d2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:56.005497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff8ce114-2aa9-471f-98fd-3424c1eb7d2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:56.021267 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-beb4e026-2892-4a53-aeb1-394c77ec1596 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:56.030635 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-beb4e026-2892-4a53-aeb1-394c77ec1596 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:56.032125 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-beb4e026-2892-4a53-aeb1-394c77ec1596 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:56.033285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-beb4e026-2892-4a53-aeb1-394c77ec1596 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.204901 Sep 17 21:06:56.033883 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 186/385] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:55 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:56.178864 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff8ce114-2aa9-471f-98fd-3424c1eb7d2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:56.186491 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff8ce114-2aa9-471f-98fd-3424c1eb7d2c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1522 microversion: 2.1 time: 0.197581 Sep 17 21:06:56.187034 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 200/386] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:55 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:57.060028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c8a73e1f-99bb-47a0-a2d7-afe93bef79a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.060651 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c8a73e1f-99bb-47a0-a2d7-afe93bef79a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:57.067547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8a73e1f-99bb-47a0-a2d7-afe93bef79a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.068149 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8a73e1f-99bb-47a0-a2d7-afe93bef79a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.068768 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8a73e1f-99bb-47a0-a2d7-afe93bef79a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.069535 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8a73e1f-99bb-47a0-a2d7-afe93bef79a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.069987 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8a73e1f-99bb-47a0-a2d7-afe93bef79a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.070672 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8a73e1f-99bb-47a0-a2d7-afe93bef79a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.088905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:57.204642 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8a73e1f-99bb-47a0-a2d7-afe93bef79a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:57.211272 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd278e21-e3b2-4009-ae39-964478c9026d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.212648 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd278e21-e3b2-4009-ae39-964478c9026d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:57.215887 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8a73e1f-99bb-47a0-a2d7-afe93bef79a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:57.217497 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8a73e1f-99bb-47a0-a2d7-afe93bef79a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:57.218644 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd278e21-e3b2-4009-ae39-964478c9026d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.218790 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c8a73e1f-99bb-47a0-a2d7-afe93bef79a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1406 microversion: 2.20 time: 0.164446 Sep 17 21:06:57.219134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd278e21-e3b2-4009-ae39-964478c9026d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.219531 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 187/387] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:57 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:57.232938 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd278e21-e3b2-4009-ae39-964478c9026d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.232938 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd278e21-e3b2-4009-ae39-964478c9026d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.232938 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd278e21-e3b2-4009-ae39-964478c9026d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.232938 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd278e21-e3b2-4009-ae39-964478c9026d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.353238 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-dd278e21-e3b2-4009-ae39-964478c9026d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:57.360781 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd278e21-e3b2-4009-ae39-964478c9026d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1522 microversion: 2.1 time: 0.155209 Sep 17 21:06:57.361342 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 201/388] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:57 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:58.245538 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a842dea7-e999-4e37-811d-b40a45e690a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:58.246228 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a842dea7-e999-4e37-811d-b40a45e690a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:58.253066 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a842dea7-e999-4e37-811d-b40a45e690a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:58.254075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a842dea7-e999-4e37-811d-b40a45e690a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:58.254576 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a842dea7-e999-4e37-811d-b40a45e690a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:58.255262 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a842dea7-e999-4e37-811d-b40a45e690a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:58.255715 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a842dea7-e999-4e37-811d-b40a45e690a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:58.256133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a842dea7-e999-4e37-811d-b40a45e690a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:58.383385 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a842dea7-e999-4e37-811d-b40a45e690a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:58.384586 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-daf4da30-0781-4130-9102-7ed4e1753bf7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:58.385296 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-daf4da30-0781-4130-9102-7ed4e1753bf7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:58.391254 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-daf4da30-0781-4130-9102-7ed4e1753bf7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:58.391986 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-daf4da30-0781-4130-9102-7ed4e1753bf7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:58.392344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a842dea7-e999-4e37-811d-b40a45e690a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:58.392567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-daf4da30-0781-4130-9102-7ed4e1753bf7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:58.393348 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-daf4da30-0781-4130-9102-7ed4e1753bf7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:58.394038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-daf4da30-0781-4130-9102-7ed4e1753bf7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:58.394193 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a842dea7-e999-4e37-811d-b40a45e690a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:58.394539 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-daf4da30-0781-4130-9102-7ed4e1753bf7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:58.395390 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a842dea7-e999-4e37-811d-b40a45e690a0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1598 microversion: 2.20 time: 0.153655 Sep 17 21:06:58.395937 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 188/389] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:58 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:58.419746 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0079a49b-aa59-410a-9622-6d036f758350 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:58.420493 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0079a49b-aa59-410a-9622-6d036f758350 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:58.427286 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0079a49b-aa59-410a-9622-6d036f758350 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:58.427788 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0079a49b-aa59-410a-9622-6d036f758350 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:58.428223 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0079a49b-aa59-410a-9622-6d036f758350 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:58.428948 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0079a49b-aa59-410a-9622-6d036f758350 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:58.429406 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0079a49b-aa59-410a-9622-6d036f758350 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:58.429829 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0079a49b-aa59-410a-9622-6d036f758350 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:58.536577 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0079a49b-aa59-410a-9622-6d036f758350 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.120715 Sep 17 21:06:58.537194 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 189/390] 10.222.0.16 () {60 vars in 1316 bytes} [Sat Sep 17 21:06:58 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 17 21:06:58.560615 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-daf4da30-0781-4130-9102-7ed4e1753bf7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:58.569027 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-daf4da30-0781-4130-9102-7ed4e1753bf7 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1522 microversion: 2.1 time: 0.188370 Sep 17 21:06:58.569685 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 202/391] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:58 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:59.593031 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c26e02b-7f38-48d1-ad43-04b3abbc22fb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:59.593627 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7c26e02b-7f38-48d1-ad43-04b3abbc22fb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:59.599996 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c26e02b-7f38-48d1-ad43-04b3abbc22fb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:59.600471 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c26e02b-7f38-48d1-ad43-04b3abbc22fb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:59.600925 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c26e02b-7f38-48d1-ad43-04b3abbc22fb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:59.601636 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c26e02b-7f38-48d1-ad43-04b3abbc22fb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:59.602084 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c26e02b-7f38-48d1-ad43-04b3abbc22fb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:59.602685 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c26e02b-7f38-48d1-ad43-04b3abbc22fb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:59.729989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7c26e02b-7f38-48d1-ad43-04b3abbc22fb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:59.737798 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7c26e02b-7f38-48d1-ad43-04b3abbc22fb tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1522 microversion: 2.1 time: 0.149091 Sep 17 21:06:59.738954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 190/392] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:59 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:59.855446 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-63e6a274-beef-4f85-9484-bb7a2f730660 req-f9ba88f0-2e6d-4a13-8fea-3e8fbff8bbad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785212fb-7493-49ce-b3f0-12b3742b3a88", "tag": "3a9a1b04-a0c4-4a66-a693-a268f50c530b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:59.865253 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-63e6a274-beef-4f85-9484-bb7a2f730660 req-f9ba88f0-2e6d-4a13-8fea-3e8fbff8bbad service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:59.865729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-63e6a274-beef-4f85-9484-bb7a2f730660 req-f9ba88f0-2e6d-4a13-8fea-3e8fbff8bbad service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:59.866166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-63e6a274-beef-4f85-9484-bb7a2f730660 req-f9ba88f0-2e6d-4a13-8fea-3e8fbff8bbad service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:59.877203 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-63e6a274-beef-4f85-9484-bb7a2f730660 req-f9ba88f0-2e6d-4a13-8fea-3e8fbff8bbad service nova] Creating event network-changed:3a9a1b04-a0c4-4a66-a693-a268f50c530b for instance 785212fb-7493-49ce-b3f0-12b3742b3a88 on hv-cinder-82651 Sep 17 21:06:59.882410 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-63e6a274-beef-4f85-9484-bb7a2f730660 req-f9ba88f0-2e6d-4a13-8fea-3e8fbff8bbad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030562 Sep 17 21:06:59.883914 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 203/393] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:00.761443 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-54901bca-ad9a-40b2-ba0e-4dd0c806a537 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:00.762046 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-54901bca-ad9a-40b2-ba0e-4dd0c806a537 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:00.769195 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54901bca-ad9a-40b2-ba0e-4dd0c806a537 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:00.769778 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54901bca-ad9a-40b2-ba0e-4dd0c806a537 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:00.770207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54901bca-ad9a-40b2-ba0e-4dd0c806a537 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:00.771593 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54901bca-ad9a-40b2-ba0e-4dd0c806a537 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:00.772085 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54901bca-ad9a-40b2-ba0e-4dd0c806a537 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:00.772527 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54901bca-ad9a-40b2-ba0e-4dd0c806a537 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:00.947076 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-54901bca-ad9a-40b2-ba0e-4dd0c806a537 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:00.954899 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-54901bca-ad9a-40b2-ba0e-4dd0c806a537 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1522 microversion: 2.1 time: 0.197224 Sep 17 21:07:00.955686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 191/394] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:00 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:01.978998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53ec01dc-142c-4ac6-a2e2-44834860d10a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:01.979733 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-53ec01dc-142c-4ac6-a2e2-44834860d10a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:01.986565 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53ec01dc-142c-4ac6-a2e2-44834860d10a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:01.987048 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53ec01dc-142c-4ac6-a2e2-44834860d10a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:01.987484 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53ec01dc-142c-4ac6-a2e2-44834860d10a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:01.988221 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53ec01dc-142c-4ac6-a2e2-44834860d10a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:01.988689 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53ec01dc-142c-4ac6-a2e2-44834860d10a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:01.989123 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53ec01dc-142c-4ac6-a2e2-44834860d10a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:02.117000 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-53ec01dc-142c-4ac6-a2e2-44834860d10a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:02.124460 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53ec01dc-142c-4ac6-a2e2-44834860d10a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1522 microversion: 2.1 time: 0.149736 Sep 17 21:07:02.125044 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 204/395] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:01 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:03.039985 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-287422116", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:03.091678 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:07:03.148175 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a4a94f87-4411-4640-bdb3-d80d2a072a46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:03.148817 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a4a94f87-4411-4640-bdb3-d80d2a072a46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:03.154826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4a94f87-4411-4640-bdb3-d80d2a072a46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:03.155237 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4a94f87-4411-4640-bdb3-d80d2a072a46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:03.155668 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4a94f87-4411-4640-bdb3-d80d2a072a46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:03.156538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4a94f87-4411-4640-bdb3-d80d2a072a46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:03.157015 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4a94f87-4411-4640-bdb3-d80d2a072a46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:03.157453 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4a94f87-4411-4640-bdb3-d80d2a072a46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:03.402644 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a4a94f87-4411-4640-bdb3-d80d2a072a46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:03.410812 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a4a94f87-4411-4640-bdb3-d80d2a072a46 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1522 microversion: 2.1 time: 0.267260 Sep 17 21:07:03.411398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 205/396] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:03 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:03.431664 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:07:03.432091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:07:03.432571 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:07:03.433016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:07:03.433431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:07:03.443089 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:03.443573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:03.444011 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:03.444775 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:03.445238 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:03.445959 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:03.463196 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Getting quotas for project 7b9af3a8a7b3493a817ec028e67f707f. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:07:03.467166 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Getting quotas for user 9c13e37200d0432788156ae78daaca53 and project 7b9af3a8a7b3493a817ec028e67f707f. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:07:03.478104 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:07:03.480377 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:07:03.526308 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-942734e7-9647-4651-b0b3-4430e20c8d18 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.490349 Sep 17 21:07:03.527144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 192/397] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:07:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:07:03.538025 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9490c6c0-4f52-4270-ae17-0c51971fbd14 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:03.538742 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9490c6c0-4f52-4270-ae17-0c51971fbd14 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:03.591276 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9490c6c0-4f52-4270-ae17-0c51971fbd14 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:03.598357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9490c6c0-4f52-4270-ae17-0c51971fbd14 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1214 microversion: 2.1 time: 0.064219 Sep 17 21:07:03.598924 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 206/398] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:03 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:04.434865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b5a2998d-09c0-48b9-b635-3fa0ebb57097 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:04.435454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b5a2998d-09c0-48b9-b635-3fa0ebb57097 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:04.444526 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a2998d-09c0-48b9-b635-3fa0ebb57097 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:04.445057 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a2998d-09c0-48b9-b635-3fa0ebb57097 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:04.445767 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a2998d-09c0-48b9-b635-3fa0ebb57097 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:04.446496 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a2998d-09c0-48b9-b635-3fa0ebb57097 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:04.446942 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a2998d-09c0-48b9-b635-3fa0ebb57097 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:04.447361 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a2998d-09c0-48b9-b635-3fa0ebb57097 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:04.593701 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b5a2998d-09c0-48b9-b635-3fa0ebb57097 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:04.601374 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b5a2998d-09c0-48b9-b635-3fa0ebb57097 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1522 microversion: 2.1 time: 0.170731 Sep 17 21:07:04.601932 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 193/399] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:04 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:04.621608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c38d3f46-7f51-4c06-ac82-276bdecf05d5 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:04.622240 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c38d3f46-7f51-4c06-ac82-276bdecf05d5 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:04.628131 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c38d3f46-7f51-4c06-ac82-276bdecf05d5 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:04.629273 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c38d3f46-7f51-4c06-ac82-276bdecf05d5 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:04.629700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c38d3f46-7f51-4c06-ac82-276bdecf05d5 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:04.630383 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c38d3f46-7f51-4c06-ac82-276bdecf05d5 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:04.630834 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c38d3f46-7f51-4c06-ac82-276bdecf05d5 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:04.631249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c38d3f46-7f51-4c06-ac82-276bdecf05d5 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:04.690177 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c38d3f46-7f51-4c06-ac82-276bdecf05d5 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:04.698781 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c38d3f46-7f51-4c06-ac82-276bdecf05d5 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1266 microversion: 2.1 time: 0.080998 Sep 17 21:07:04.699332 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 207/400] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:04 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:05.624253 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63655d1d-8c65-4f0c-bd1b-33a244dd16e0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:05.624849 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63655d1d-8c65-4f0c-bd1b-33a244dd16e0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:05.631762 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63655d1d-8c65-4f0c-bd1b-33a244dd16e0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:05.632244 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63655d1d-8c65-4f0c-bd1b-33a244dd16e0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:05.632708 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63655d1d-8c65-4f0c-bd1b-33a244dd16e0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:05.633408 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63655d1d-8c65-4f0c-bd1b-33a244dd16e0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:05.633867 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63655d1d-8c65-4f0c-bd1b-33a244dd16e0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:05.634294 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63655d1d-8c65-4f0c-bd1b-33a244dd16e0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:05.721057 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c08d350e-887e-4c9c-bd2b-71d1946b9528 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:05.721680 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c08d350e-887e-4c9c-bd2b-71d1946b9528 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:05.727724 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c08d350e-887e-4c9c-bd2b-71d1946b9528 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:05.728207 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c08d350e-887e-4c9c-bd2b-71d1946b9528 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:05.728642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c08d350e-887e-4c9c-bd2b-71d1946b9528 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:05.729365 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c08d350e-887e-4c9c-bd2b-71d1946b9528 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:05.729822 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c08d350e-887e-4c9c-bd2b-71d1946b9528 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:05.730249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c08d350e-887e-4c9c-bd2b-71d1946b9528 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:05.760896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-63655d1d-8c65-4f0c-bd1b-33a244dd16e0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:05.768559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63655d1d-8c65-4f0c-bd1b-33a244dd16e0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1522 microversion: 2.1 time: 0.148286 Sep 17 21:07:05.769784 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 194/401] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:05 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:05.793717 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c08d350e-887e-4c9c-bd2b-71d1946b9528 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:05.801620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c08d350e-887e-4c9c-bd2b-71d1946b9528 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1266 microversion: 2.1 time: 0.084295 Sep 17 21:07:05.802173 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 208/402] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:05 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:06.792093 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-797b7a5f-6c36-4b95-bb4d-1b8e756afa8b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:06.792841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-797b7a5f-6c36-4b95-bb4d-1b8e756afa8b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:06.799627 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797b7a5f-6c36-4b95-bb4d-1b8e756afa8b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:06.800109 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797b7a5f-6c36-4b95-bb4d-1b8e756afa8b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:06.800540 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797b7a5f-6c36-4b95-bb4d-1b8e756afa8b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:06.801260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797b7a5f-6c36-4b95-bb4d-1b8e756afa8b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:06.801713 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797b7a5f-6c36-4b95-bb4d-1b8e756afa8b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:06.802129 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797b7a5f-6c36-4b95-bb4d-1b8e756afa8b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:06.824199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a801419-7533-4b27-be67-1d5f4ad33c3c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:06.824854 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a801419-7533-4b27-be67-1d5f4ad33c3c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:06.831068 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a801419-7533-4b27-be67-1d5f4ad33c3c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:06.832153 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a801419-7533-4b27-be67-1d5f4ad33c3c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:06.832583 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a801419-7533-4b27-be67-1d5f4ad33c3c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:06.833687 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a801419-7533-4b27-be67-1d5f4ad33c3c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:06.834144 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a801419-7533-4b27-be67-1d5f4ad33c3c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:06.834723 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a801419-7533-4b27-be67-1d5f4ad33c3c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:06.906392 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a801419-7533-4b27-be67-1d5f4ad33c3c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:06.918498 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a801419-7533-4b27-be67-1d5f4ad33c3c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1272 microversion: 2.1 time: 0.098402 Sep 17 21:07:06.919196 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 209/403] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:06 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:06.968883 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-797b7a5f-6c36-4b95-bb4d-1b8e756afa8b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:06.977544 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-797b7a5f-6c36-4b95-bb4d-1b8e756afa8b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1502 microversion: 2.1 time: 0.189440 Sep 17 21:07:06.978227 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 195/404] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:06 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:06.999898 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1912e8b6-5175-451e-a28a-edc6f8b3bfe3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7575ea6e-0075-4619-9bb5-2f2340e836c6"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:07.002323 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1912e8b6-5175-451e-a28a-edc6f8b3bfe3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:07.009192 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1912e8b6-5175-451e-a28a-edc6f8b3bfe3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.009682 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1912e8b6-5175-451e-a28a-edc6f8b3bfe3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.010124 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1912e8b6-5175-451e-a28a-edc6f8b3bfe3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.010826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1912e8b6-5175-451e-a28a-edc6f8b3bfe3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.011287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1912e8b6-5175-451e-a28a-edc6f8b3bfe3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.011715 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1912e8b6-5175-451e-a28a-edc6f8b3bfe3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.032235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:07.039875 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-1912e8b6-5175-451e-a28a-edc6f8b3bfe3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] HTTP exception thrown: Cannot 'attach_volume' instance 19898312-d61b-457d-8217-d6c8e2ad2dbc while it is in vm_state rescued Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1912e8b6-5175-451e-a28a-edc6f8b3bfe3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Request method failure captured: Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc/os-volume_attachments HTTP/1.1 Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 74 Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZZwKfTj04T6UZy5whU5GnH06Qm2mjPMAvhRhYAf6YKOkKlLcdEUkYnhTcpRVF99d6zOw51Eu4MKu4qSCJA2DfrmeduSv2CPcOO2IOE6No0aJf0pyRwS9JPzSXJja0gkzZZ92NWtZdGv-AVZ4Zt9rvw5MPu-tY6pkTxKJ91Ococ8o8 Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: 1e42842c724f480f9cdd5ea75707b43f Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:07:07.041575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:07:07.043176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:07:07.043176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:07:07.043176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 1e42842c724f480f9cdd5ea75707b43f Sep 17 21:07:07.043176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:07:07.043176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-ServerRescueNegativeTestJSON-593011089-project Sep 17 21:07:07.043176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:07:07.043176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:07:07.043176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: a3dac44116784a9e963a69e4793bac4b Sep 17 21:07:07.043176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593011089-project Sep 17 21:07:07.043176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Sep 17 21:07:07.043176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {"volumeAttachment": {"volumeId": "7575ea6e-0075-4619-9bb5-2f2340e836c6"}} Sep 17 21:07:07.043176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Cannot 'attach_volume' instance 19898312-d61b-457d-8217-d6c8e2ad2dbc while it is in vm_state rescued Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'server_id': '19898312-d61b-457d-8217-d6c8e2ad2dbc', 'body': {'volumeAttachment': {'volumeId': '7575ea6e-0075-4619-9bb5-2f2340e836c6'}}} Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 19898312-d61b-457d-8217-d6c8e2ad2dbc in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:07.043990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 19898312-d61b-457d-8217-d6c8e2ad2dbc while it is in vm_state rescued Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:07.045346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:07.046645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:07.046645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:07.046645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 19898312-d61b-457d-8217-d6c8e2ad2dbc while it is in vm_state rescued Sep 17 21:07:07.046645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:07:07.046645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1912e8b6-5175-451e-a28a-edc6f8b3bfe3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Returning 409 to user: Cannot 'attach_volume' instance 19898312-d61b-457d-8217-d6c8e2ad2dbc while it is in vm_state rescued {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:07.046645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1912e8b6-5175-451e-a28a-edc6f8b3bfe3 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "POST /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047124 Sep 17 21:07:07.046645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 210/405] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:07:06 2022] POST /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:07:07.052913 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6a28fa6-3041-47a0-b762-186cf57c3c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:07.053450 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d6a28fa6-3041-47a0-b762-186cf57c3c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:07.059398 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6a28fa6-3041-47a0-b762-186cf57c3c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.059885 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6a28fa6-3041-47a0-b762-186cf57c3c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.060324 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6a28fa6-3041-47a0-b762-186cf57c3c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.061061 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6a28fa6-3041-47a0-b762-186cf57c3c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.061519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6a28fa6-3041-47a0-b762-186cf57c3c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.061946 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6a28fa6-3041-47a0-b762-186cf57c3c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.133482 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6a28fa6-3041-47a0-b762-186cf57c3c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "POST /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc/action" status: 202 len: 0 microversion: 2.1 time: 0.084917 Sep 17 21:07:07.134202 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 196/406] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:07:07 2022] POST /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:07:07.142361 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49ce5395-3a74-4a8f-b0c1-f110bcc9ca7b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:07.142976 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49ce5395-3a74-4a8f-b0c1-f110bcc9ca7b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:07.150700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49ce5395-3a74-4a8f-b0c1-f110bcc9ca7b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.151196 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49ce5395-3a74-4a8f-b0c1-f110bcc9ca7b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.151642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49ce5395-3a74-4a8f-b0c1-f110bcc9ca7b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.152345 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49ce5395-3a74-4a8f-b0c1-f110bcc9ca7b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.152848 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49ce5395-3a74-4a8f-b0c1-f110bcc9ca7b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.153272 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49ce5395-3a74-4a8f-b0c1-f110bcc9ca7b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.384343 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-49ce5395-3a74-4a8f-b0c1-f110bcc9ca7b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:07.398811 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49ce5395-3a74-4a8f-b0c1-f110bcc9ca7b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1510 microversion: 2.1 time: 0.260245 Sep 17 21:07:07.399412 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 211/407] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:07 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:07.936478 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9c84af13-d77e-40e6-a644-d4aaa74c411c req-e796f0ab-7970-4241-a73c-59d3c4166677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d", "tag": "ff080199-aca6-44dd-ab11-21d108f9eb89"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:07.942372 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d4b005d-898c-4928-b8cd-5115d14681c9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:07.943111 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3d4b005d-898c-4928-b8cd-5115d14681c9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:07.955398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d4b005d-898c-4928-b8cd-5115d14681c9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.956275 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d4b005d-898c-4928-b8cd-5115d14681c9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.961480 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9c84af13-d77e-40e6-a644-d4aaa74c411c req-e796f0ab-7970-4241-a73c-59d3c4166677 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.962111 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d4b005d-898c-4928-b8cd-5115d14681c9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.962841 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d4b005d-898c-4928-b8cd-5115d14681c9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.963309 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d4b005d-898c-4928-b8cd-5115d14681c9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.963730 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d4b005d-898c-4928-b8cd-5115d14681c9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.968289 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9c84af13-d77e-40e6-a644-d4aaa74c411c req-e796f0ab-7970-4241-a73c-59d3c4166677 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.968755 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9c84af13-d77e-40e6-a644-d4aaa74c411c req-e796f0ab-7970-4241-a73c-59d3c4166677 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.990083 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9c84af13-d77e-40e6-a644-d4aaa74c411c req-e796f0ab-7970-4241-a73c-59d3c4166677 service nova] Creating event network-changed:ff080199-aca6-44dd-ab11-21d108f9eb89 for instance 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d on hv-cinder-82651 Sep 17 21:07:07.994773 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9c84af13-d77e-40e6-a644-d4aaa74c411c req-e796f0ab-7970-4241-a73c-59d3c4166677 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063210 Sep 17 21:07:07.995369 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 197/408] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:07:08.108704 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3d4b005d-898c-4928-b8cd-5115d14681c9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:08.117274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3d4b005d-898c-4928-b8cd-5115d14681c9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1314 microversion: 2.1 time: 0.179010 Sep 17 21:07:08.122458 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 212/409] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:07 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:08.423497 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-709cd230-3359-44b2-a256-a8575a0aa61f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:08.424183 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-709cd230-3359-44b2-a256-a8575a0aa61f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:08.430602 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-709cd230-3359-44b2-a256-a8575a0aa61f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.431086 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-709cd230-3359-44b2-a256-a8575a0aa61f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.431519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-709cd230-3359-44b2-a256-a8575a0aa61f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.432210 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-709cd230-3359-44b2-a256-a8575a0aa61f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.432746 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-709cd230-3359-44b2-a256-a8575a0aa61f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.433170 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-709cd230-3359-44b2-a256-a8575a0aa61f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.559327 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-709cd230-3359-44b2-a256-a8575a0aa61f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:08.567450 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-709cd230-3359-44b2-a256-a8575a0aa61f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1510 microversion: 2.1 time: 0.148067 Sep 17 21:07:08.567999 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 198/410] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:08 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:09.140256 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a90a6a11-35ff-4d54-b562-79c1330d7023 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:09.140919 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a90a6a11-35ff-4d54-b562-79c1330d7023 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:09.147062 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a90a6a11-35ff-4d54-b562-79c1330d7023 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:09.147519 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a90a6a11-35ff-4d54-b562-79c1330d7023 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:09.147947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a90a6a11-35ff-4d54-b562-79c1330d7023 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:09.148634 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a90a6a11-35ff-4d54-b562-79c1330d7023 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:09.149110 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a90a6a11-35ff-4d54-b562-79c1330d7023 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:09.149528 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a90a6a11-35ff-4d54-b562-79c1330d7023 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:09.278287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a90a6a11-35ff-4d54-b562-79c1330d7023 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:09.286380 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a90a6a11-35ff-4d54-b562-79c1330d7023 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1314 microversion: 2.1 time: 0.150085 Sep 17 21:07:09.286939 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 213/411] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:09 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:09.590859 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-efda93bb-166a-41f4-942e-380970798a1d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:09.591467 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-efda93bb-166a-41f4-942e-380970798a1d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:09.598368 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efda93bb-166a-41f4-942e-380970798a1d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:09.598853 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efda93bb-166a-41f4-942e-380970798a1d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:09.599289 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efda93bb-166a-41f4-942e-380970798a1d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:09.599974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efda93bb-166a-41f4-942e-380970798a1d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:09.600427 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efda93bb-166a-41f4-942e-380970798a1d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:09.600959 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efda93bb-166a-41f4-942e-380970798a1d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:09.726038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-efda93bb-166a-41f4-942e-380970798a1d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:09.733711 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-efda93bb-166a-41f4-942e-380970798a1d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1510 microversion: 2.1 time: 0.146770 Sep 17 21:07:09.734265 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 199/412] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:09 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:10.309624 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3fde5363-616b-4f9a-97a3-bb8ec16b31e1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:10.310256 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3fde5363-616b-4f9a-97a3-bb8ec16b31e1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:10.316422 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fde5363-616b-4f9a-97a3-bb8ec16b31e1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:10.316936 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fde5363-616b-4f9a-97a3-bb8ec16b31e1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:10.317369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fde5363-616b-4f9a-97a3-bb8ec16b31e1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:10.318050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fde5363-616b-4f9a-97a3-bb8ec16b31e1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:10.318501 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fde5363-616b-4f9a-97a3-bb8ec16b31e1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:10.318918 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fde5363-616b-4f9a-97a3-bb8ec16b31e1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:10.446640 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3fde5363-616b-4f9a-97a3-bb8ec16b31e1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:10.454364 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3fde5363-616b-4f9a-97a3-bb8ec16b31e1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1314 microversion: 2.1 time: 0.148800 Sep 17 21:07:10.454910 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 214/413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:10 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:10.757676 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3923e3e8-f9d9-49cb-afa0-57cfe991e28d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:10.758281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3923e3e8-f9d9-49cb-afa0-57cfe991e28d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:10.764646 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3923e3e8-f9d9-49cb-afa0-57cfe991e28d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:10.765158 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3923e3e8-f9d9-49cb-afa0-57cfe991e28d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:10.765592 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3923e3e8-f9d9-49cb-afa0-57cfe991e28d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:10.766282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3923e3e8-f9d9-49cb-afa0-57cfe991e28d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:10.766830 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3923e3e8-f9d9-49cb-afa0-57cfe991e28d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:10.767253 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3923e3e8-f9d9-49cb-afa0-57cfe991e28d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:10.895979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3923e3e8-f9d9-49cb-afa0-57cfe991e28d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:10.903568 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3923e3e8-f9d9-49cb-afa0-57cfe991e28d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1510 microversion: 2.1 time: 0.150362 Sep 17 21:07:10.904121 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 200/414] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:10 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:11.480521 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1181182e-2d19-4e48-8090-b3e43846b8b6 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:11.481151 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1181182e-2d19-4e48-8090-b3e43846b8b6 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:11.487226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1181182e-2d19-4e48-8090-b3e43846b8b6 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:11.488338 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1181182e-2d19-4e48-8090-b3e43846b8b6 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:11.488809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1181182e-2d19-4e48-8090-b3e43846b8b6 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:11.489504 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1181182e-2d19-4e48-8090-b3e43846b8b6 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:11.489989 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1181182e-2d19-4e48-8090-b3e43846b8b6 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:11.490409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1181182e-2d19-4e48-8090-b3e43846b8b6 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:11.615817 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1181182e-2d19-4e48-8090-b3e43846b8b6 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:11.623490 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1181182e-2d19-4e48-8090-b3e43846b8b6 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1314 microversion: 2.1 time: 0.146762 Sep 17 21:07:11.624053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 215/415] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:11 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:11.926454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bca42953-f5df-48c3-9511-a5c6c51c96cc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:11.927056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bca42953-f5df-48c3-9511-a5c6c51c96cc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:11.933396 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bca42953-f5df-48c3-9511-a5c6c51c96cc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:11.933875 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bca42953-f5df-48c3-9511-a5c6c51c96cc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:11.934305 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bca42953-f5df-48c3-9511-a5c6c51c96cc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:11.934993 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bca42953-f5df-48c3-9511-a5c6c51c96cc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:11.935441 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bca42953-f5df-48c3-9511-a5c6c51c96cc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:11.935860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bca42953-f5df-48c3-9511-a5c6c51c96cc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:12.065051 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bca42953-f5df-48c3-9511-a5c6c51c96cc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:12.073503 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bca42953-f5df-48c3-9511-a5c6c51c96cc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1516 microversion: 2.1 time: 0.151159 Sep 17 21:07:12.074051 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 201/416] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:11 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:12.647129 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2508eda-2ecd-4c9d-b7af-a509cf5709ad tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:12.647661 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2508eda-2ecd-4c9d-b7af-a509cf5709ad tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:12.653693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2508eda-2ecd-4c9d-b7af-a509cf5709ad tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:12.654179 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2508eda-2ecd-4c9d-b7af-a509cf5709ad tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:12.654654 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2508eda-2ecd-4c9d-b7af-a509cf5709ad tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:12.655348 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2508eda-2ecd-4c9d-b7af-a509cf5709ad tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:12.655807 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2508eda-2ecd-4c9d-b7af-a509cf5709ad tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:12.656234 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2508eda-2ecd-4c9d-b7af-a509cf5709ad tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:12.781733 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2508eda-2ecd-4c9d-b7af-a509cf5709ad tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:12.789718 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c2508eda-2ecd-4c9d-b7af-a509cf5709ad tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1314 microversion: 2.1 time: 0.146604 Sep 17 21:07:12.790276 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 216/417] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:12 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:13.422865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32ce59e3-0f12-475b-a22b-c8059dcc7adc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Action: 'create', calling method: .version_select at 0x7f9ba792b8b0>, body: {"keypair": {"name": "tempest-keypair-1403007556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBV0UKfHOFznZC//CIuyMfyDuR1zF+qg6GbLovY4JjAoR7el+zNTCNsgIsFbzG60HftuLOQz+Rmo80Zwxn0ADvwGhQ8Ma5X08Gz+/CAE8THITQfePR94ZRfwW1/Nbay/w=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:13.438785 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-32ce59e3-0f12-475b-a22b-c8059dcc7adc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Getting quotas for project 1e42842c724f480f9cdd5ea75707b43f. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:07:13.442800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-32ce59e3-0f12-475b-a22b-c8059dcc7adc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Getting quotas for user a3dac44116784a9e963a69e4793bac4b and project 1e42842c724f480f9cdd5ea75707b43f. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:07:13.453177 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:13.467441 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32ce59e3-0f12-475b-a22b-c8059dcc7adc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048467 Sep 17 21:07:13.468033 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 202/418] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 17 21:07:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:13.813287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5a4cff20-7060-4f3b-bfe5-1024b54a9437 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:13.813918 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5a4cff20-7060-4f3b-bfe5-1024b54a9437 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:13.815967 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:13.821935 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a4cff20-7060-4f3b-bfe5-1024b54a9437 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:13.822441 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a4cff20-7060-4f3b-bfe5-1024b54a9437 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:13.822898 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a4cff20-7060-4f3b-bfe5-1024b54a9437 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:13.823658 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a4cff20-7060-4f3b-bfe5-1024b54a9437 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:13.824120 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a4cff20-7060-4f3b-bfe5-1024b54a9437 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:13.824526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a4cff20-7060-4f3b-bfe5-1024b54a9437 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:13.957685 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5a4cff20-7060-4f3b-bfe5-1024b54a9437 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:13.965432 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5a4cff20-7060-4f3b-bfe5-1024b54a9437 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1314 microversion: 2.1 time: 0.155853 Sep 17 21:07:13.966001 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 217/419] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:13 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:14.990162 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-65993825-9ff9-4644-bf8c-118aaaf0993b tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:14.990971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-65993825-9ff9-4644-bf8c-118aaaf0993b tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:14.997871 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65993825-9ff9-4644-bf8c-118aaaf0993b tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:14.998355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65993825-9ff9-4644-bf8c-118aaaf0993b tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:14.998781 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65993825-9ff9-4644-bf8c-118aaaf0993b tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:14.999478 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65993825-9ff9-4644-bf8c-118aaaf0993b tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:14.999926 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65993825-9ff9-4644-bf8c-118aaaf0993b tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:15.000347 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65993825-9ff9-4644-bf8c-118aaaf0993b tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:15.225108 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-65993825-9ff9-4644-bf8c-118aaaf0993b tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:15.232847 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-65993825-9ff9-4644-bf8c-118aaaf0993b tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1314 microversion: 2.1 time: 0.248035 Sep 17 21:07:15.233407 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 203/420] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:14 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:15.362751 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-427821717", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "676f4f8e-4659-4332-b7d1-9e707434a08e"}], "security_groups": [{"name": "tempest-securitygroup--866481079"}], "key_name": "tempest-keypair-1403007556", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:15.467604 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] validate_networks() for [('676f4f8e-4659-4332-b7d1-9e707434a08e', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:07:15.840617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:07:15.841300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:07:15.841826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:07:15.842235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:07:15.842647 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:07:15.852027 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:15.852507 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:15.852973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:15.853693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:15.854143 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:15.854561 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:15.872779 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Getting quotas for project 1e42842c724f480f9cdd5ea75707b43f. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:07:15.876973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Getting quotas for user a3dac44116784a9e963a69e4793bac4b and project 1e42842c724f480f9cdd5ea75707b43f. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:07:15.888690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:07:15.891008 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:07:15.941334 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2bda2391-31ff-4216-9212-31c540a4961a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.582008 Sep 17 21:07:15.942222 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 218/421] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:07:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:07:15.953206 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fa33fce1-7334-4e79-904a-94c2bbc4686f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:15.954048 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fa33fce1-7334-4e79-904a-94c2bbc4686f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:16.027483 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fa33fce1-7334-4e79-904a-94c2bbc4686f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:16.034994 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fa33fce1-7334-4e79-904a-94c2bbc4686f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1245 microversion: 2.1 time: 0.085491 Sep 17 21:07:16.036086 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 204/422] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:15 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:16.256168 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a179d13-c189-446b-917b-deca29d726c1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:16.256830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1a179d13-c189-446b-917b-deca29d726c1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:16.265792 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a179d13-c189-446b-917b-deca29d726c1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:16.266184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a179d13-c189-446b-917b-deca29d726c1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:16.266813 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a179d13-c189-446b-917b-deca29d726c1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:16.267590 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a179d13-c189-446b-917b-deca29d726c1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:16.268053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a179d13-c189-446b-917b-deca29d726c1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:16.269116 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a179d13-c189-446b-917b-deca29d726c1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:16.404240 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a179d13-c189-446b-917b-deca29d726c1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:16.412203 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a179d13-c189-446b-917b-deca29d726c1 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1314 microversion: 2.1 time: 0.160589 Sep 17 21:07:16.412975 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 219/423] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:16 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:17.058216 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e58b4adf-edd7-40d8-8ca4-4c5866caf410 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:17.058845 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e58b4adf-edd7-40d8-8ca4-4c5866caf410 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:17.066076 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e58b4adf-edd7-40d8-8ca4-4c5866caf410 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:17.066590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e58b4adf-edd7-40d8-8ca4-4c5866caf410 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:17.067019 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e58b4adf-edd7-40d8-8ca4-4c5866caf410 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:17.067698 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e58b4adf-edd7-40d8-8ca4-4c5866caf410 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:17.068146 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e58b4adf-edd7-40d8-8ca4-4c5866caf410 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:17.068565 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e58b4adf-edd7-40d8-8ca4-4c5866caf410 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:17.132741 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e58b4adf-edd7-40d8-8ca4-4c5866caf410 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:17.140616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e58b4adf-edd7-40d8-8ca4-4c5866caf410 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1297 microversion: 2.1 time: 0.086206 Sep 17 21:07:17.141206 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 205/424] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:17 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:17.436805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5e8b57e-91e1-43c7-acb7-41a3bd0f1eec tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:17.437418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b5e8b57e-91e1-43c7-acb7-41a3bd0f1eec tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:17.443343 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5e8b57e-91e1-43c7-acb7-41a3bd0f1eec tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:17.443830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5e8b57e-91e1-43c7-acb7-41a3bd0f1eec tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:17.444276 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5e8b57e-91e1-43c7-acb7-41a3bd0f1eec tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:17.444990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5e8b57e-91e1-43c7-acb7-41a3bd0f1eec tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:17.445705 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5e8b57e-91e1-43c7-acb7-41a3bd0f1eec tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:17.446132 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5e8b57e-91e1-43c7-acb7-41a3bd0f1eec tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:17.578440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b5e8b57e-91e1-43c7-acb7-41a3bd0f1eec tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:17.586262 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5e8b57e-91e1-43c7-acb7-41a3bd0f1eec tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1314 microversion: 2.1 time: 0.153408 Sep 17 21:07:17.586823 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 220/425] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:17 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:17.866786 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2c4557a1-082d-4b64-8494-5489cc0a6a38 req-72e96300-2bfa-4d5e-b67c-0fd67b0edfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d", "name": "network-vif-plugged", "status": "completed", "tag": "ff080199-aca6-44dd-ab11-21d108f9eb89"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:17.877460 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2c4557a1-082d-4b64-8494-5489cc0a6a38 req-72e96300-2bfa-4d5e-b67c-0fd67b0edfda service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:17.879216 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2c4557a1-082d-4b64-8494-5489cc0a6a38 req-72e96300-2bfa-4d5e-b67c-0fd67b0edfda service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:17.879744 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2c4557a1-082d-4b64-8494-5489cc0a6a38 req-72e96300-2bfa-4d5e-b67c-0fd67b0edfda service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:17.891655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2c4557a1-082d-4b64-8494-5489cc0a6a38 req-72e96300-2bfa-4d5e-b67c-0fd67b0edfda service nova] Creating event network-vif-plugged:ff080199-aca6-44dd-ab11-21d108f9eb89 for instance 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d on hv-cinder-82651 Sep 17 21:07:17.898060 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2c4557a1-082d-4b64-8494-5489cc0a6a38 req-72e96300-2bfa-4d5e-b67c-0fd67b0edfda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035814 Sep 17 21:07:17.899094 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 206/426] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:07:18.164746 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c8fa8009-0f61-4349-8b02-b1318d0481d2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:18.165588 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c8fa8009-0f61-4349-8b02-b1318d0481d2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:18.174163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8fa8009-0f61-4349-8b02-b1318d0481d2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:18.175198 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8fa8009-0f61-4349-8b02-b1318d0481d2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:18.175645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8fa8009-0f61-4349-8b02-b1318d0481d2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:18.176486 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8fa8009-0f61-4349-8b02-b1318d0481d2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:18.176981 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8fa8009-0f61-4349-8b02-b1318d0481d2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:18.177415 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8fa8009-0f61-4349-8b02-b1318d0481d2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:18.325581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c8fa8009-0f61-4349-8b02-b1318d0481d2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:18.333345 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c8fa8009-0f61-4349-8b02-b1318d0481d2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1370 microversion: 2.1 time: 0.172727 Sep 17 21:07:18.333917 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 221/427] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:18 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:18.610859 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21d3cac1-bcf8-430c-a6dd-ff8e0d722917 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:18.611514 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-21d3cac1-bcf8-430c-a6dd-ff8e0d722917 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:18.618422 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21d3cac1-bcf8-430c-a6dd-ff8e0d722917 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:18.618910 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21d3cac1-bcf8-430c-a6dd-ff8e0d722917 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:18.619353 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21d3cac1-bcf8-430c-a6dd-ff8e0d722917 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:18.620052 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21d3cac1-bcf8-430c-a6dd-ff8e0d722917 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:18.620509 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21d3cac1-bcf8-430c-a6dd-ff8e0d722917 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:18.621024 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21d3cac1-bcf8-430c-a6dd-ff8e0d722917 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:18.638962 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:18.663053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-87ab26d2-a395-41ec-bc13-f557c6c789fa req-c286e49b-fb0c-429e-9aa5-eaaef69edfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643a631e-9207-4669-a0bb-623a4a8ebf94", "tag": "29f4bfa6-fb19-459c-af27-5bbb69ad95bd"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:18.674569 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-87ab26d2-a395-41ec-bc13-f557c6c789fa req-c286e49b-fb0c-429e-9aa5-eaaef69edfa4 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:18.675275 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-87ab26d2-a395-41ec-bc13-f557c6c789fa req-c286e49b-fb0c-429e-9aa5-eaaef69edfa4 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:18.675820 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-87ab26d2-a395-41ec-bc13-f557c6c789fa req-c286e49b-fb0c-429e-9aa5-eaaef69edfa4 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:18.687546 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-87ab26d2-a395-41ec-bc13-f557c6c789fa req-c286e49b-fb0c-429e-9aa5-eaaef69edfa4 service nova] Creating event network-changed:29f4bfa6-fb19-459c-af27-5bbb69ad95bd for instance 643a631e-9207-4669-a0bb-623a4a8ebf94 on hv-cinder-82651 Sep 17 21:07:18.692852 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-87ab26d2-a395-41ec-bc13-f557c6c789fa req-c286e49b-fb0c-429e-9aa5-eaaef69edfa4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034211 Sep 17 21:07:18.693817 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 222/428] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:07:18.788877 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-21d3cac1-bcf8-430c-a6dd-ff8e0d722917 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:18.796599 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-21d3cac1-bcf8-430c-a6dd-ff8e0d722917 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1314 microversion: 2.1 time: 0.190506 Sep 17 21:07:18.797187 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 207/429] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:18 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:19.357678 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6d2b4f17-fab4-4c4f-883a-d154dfda9425 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:19.358462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6d2b4f17-fab4-4c4f-883a-d154dfda9425 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:19.365692 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d2b4f17-fab4-4c4f-883a-d154dfda9425 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:19.366179 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d2b4f17-fab4-4c4f-883a-d154dfda9425 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:19.366615 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d2b4f17-fab4-4c4f-883a-d154dfda9425 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:19.367318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d2b4f17-fab4-4c4f-883a-d154dfda9425 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:19.367773 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d2b4f17-fab4-4c4f-883a-d154dfda9425 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:19.368268 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d2b4f17-fab4-4c4f-883a-d154dfda9425 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:19.564097 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6d2b4f17-fab4-4c4f-883a-d154dfda9425 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:19.573071 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6d2b4f17-fab4-4c4f-883a-d154dfda9425 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1370 microversion: 2.1 time: 0.219542 Sep 17 21:07:19.573656 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 223/430] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:19 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:19.819989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf1de9a6-048a-4503-a30f-70b9177b7b6f tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:19.820895 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bf1de9a6-048a-4503-a30f-70b9177b7b6f tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:19.827241 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf1de9a6-048a-4503-a30f-70b9177b7b6f tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:19.827845 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf1de9a6-048a-4503-a30f-70b9177b7b6f tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:19.828464 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf1de9a6-048a-4503-a30f-70b9177b7b6f tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:19.829224 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf1de9a6-048a-4503-a30f-70b9177b7b6f tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:19.829683 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf1de9a6-048a-4503-a30f-70b9177b7b6f tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:19.830111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf1de9a6-048a-4503-a30f-70b9177b7b6f tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:19.961790 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bf1de9a6-048a-4503-a30f-70b9177b7b6f tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:19.969362 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bf1de9a6-048a-4503-a30f-70b9177b7b6f tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1314 microversion: 2.1 time: 0.153319 Sep 17 21:07:19.969922 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 208/431] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:19 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:20.595297 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-43624028-71c4-4e15-8367-913538e0fdd0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:20.595906 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-43624028-71c4-4e15-8367-913538e0fdd0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:20.601997 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43624028-71c4-4e15-8367-913538e0fdd0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:20.602476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43624028-71c4-4e15-8367-913538e0fdd0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:20.602908 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43624028-71c4-4e15-8367-913538e0fdd0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:20.603598 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43624028-71c4-4e15-8367-913538e0fdd0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:20.604047 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43624028-71c4-4e15-8367-913538e0fdd0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:20.604467 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43624028-71c4-4e15-8367-913538e0fdd0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:20.729525 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-43624028-71c4-4e15-8367-913538e0fdd0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:20.736936 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-43624028-71c4-4e15-8367-913538e0fdd0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1370 microversion: 2.1 time: 0.145462 Sep 17 21:07:20.737489 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 224/432] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:20 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:20.994278 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c8f39db-c7ab-4d78-88f1-29e1dc24108a tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:20.994919 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c8f39db-c7ab-4d78-88f1-29e1dc24108a tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:20.997209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:21.003974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8f39db-c7ab-4d78-88f1-29e1dc24108a tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.004483 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8f39db-c7ab-4d78-88f1-29e1dc24108a tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.004953 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8f39db-c7ab-4d78-88f1-29e1dc24108a tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.005649 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8f39db-c7ab-4d78-88f1-29e1dc24108a tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.006107 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8f39db-c7ab-4d78-88f1-29e1dc24108a tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.006563 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8f39db-c7ab-4d78-88f1-29e1dc24108a tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.135473 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c8f39db-c7ab-4d78-88f1-29e1dc24108a tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:21.143219 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c8f39db-c7ab-4d78-88f1-29e1dc24108a tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1464 microversion: 2.1 time: 0.152762 Sep 17 21:07:21.144147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 209/433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:20 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:21.191276 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-97996ea2-e704-48b7-b148-c0a3e94f3493 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:21.191784 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-97996ea2-e704-48b7-b148-c0a3e94f3493 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:21.197917 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97996ea2-e704-48b7-b148-c0a3e94f3493 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.198398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97996ea2-e704-48b7-b148-c0a3e94f3493 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.198848 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97996ea2-e704-48b7-b148-c0a3e94f3493 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.199534 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97996ea2-e704-48b7-b148-c0a3e94f3493 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.199989 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97996ea2-e704-48b7-b148-c0a3e94f3493 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.200405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97996ea2-e704-48b7-b148-c0a3e94f3493 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.224968 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-97996ea2-e704-48b7-b148-c0a3e94f3493 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:07:21.295908 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-97996ea2-e704-48b7-b148-c0a3e94f3493 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 204 len: 0 microversion: 2.1 time: 0.108685 Sep 17 21:07:21.296386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 225/434] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:07:21 2022] DELETE /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:07:21.305058 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9cf67fb5-4c8b-4798-90ad-b58f4dea39a9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:21.305668 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9cf67fb5-4c8b-4798-90ad-b58f4dea39a9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:21.311478 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9cf67fb5-4c8b-4798-90ad-b58f4dea39a9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.311958 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9cf67fb5-4c8b-4798-90ad-b58f4dea39a9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.312390 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9cf67fb5-4c8b-4798-90ad-b58f4dea39a9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.313102 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9cf67fb5-4c8b-4798-90ad-b58f4dea39a9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.313554 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9cf67fb5-4c8b-4798-90ad-b58f4dea39a9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.313971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9cf67fb5-4c8b-4798-90ad-b58f4dea39a9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.440019 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9cf67fb5-4c8b-4798-90ad-b58f4dea39a9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:21.448072 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9cf67fb5-4c8b-4798-90ad-b58f4dea39a9 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1470 microversion: 2.1 time: 0.146791 Sep 17 21:07:21.448640 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 210/435] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:21 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:21.759691 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-51a958e6-390c-4b5d-a1bc-54bd10c58937 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:21.760380 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-51a958e6-390c-4b5d-a1bc-54bd10c58937 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:21.766358 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51a958e6-390c-4b5d-a1bc-54bd10c58937 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.766842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51a958e6-390c-4b5d-a1bc-54bd10c58937 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.767277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51a958e6-390c-4b5d-a1bc-54bd10c58937 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.767965 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51a958e6-390c-4b5d-a1bc-54bd10c58937 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.769169 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51a958e6-390c-4b5d-a1bc-54bd10c58937 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.769606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51a958e6-390c-4b5d-a1bc-54bd10c58937 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.899390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-51a958e6-390c-4b5d-a1bc-54bd10c58937 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:21.906849 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-51a958e6-390c-4b5d-a1bc-54bd10c58937 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1370 microversion: 2.1 time: 0.151451 Sep 17 21:07:21.907404 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 226/436] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:21 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:22.473538 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a4bc82b5-dc8d-4c25-8cd8-7c44e63467f0 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:22.474133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a4bc82b5-dc8d-4c25-8cd8-7c44e63467f0 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:22.480133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4bc82b5-dc8d-4c25-8cd8-7c44e63467f0 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:22.480617 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4bc82b5-dc8d-4c25-8cd8-7c44e63467f0 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:22.481073 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4bc82b5-dc8d-4c25-8cd8-7c44e63467f0 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:22.481757 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4bc82b5-dc8d-4c25-8cd8-7c44e63467f0 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:22.482269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4bc82b5-dc8d-4c25-8cd8-7c44e63467f0 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:22.482695 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4bc82b5-dc8d-4c25-8cd8-7c44e63467f0 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:22.609604 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a4bc82b5-dc8d-4c25-8cd8-7c44e63467f0 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:22.617774 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a4bc82b5-dc8d-4c25-8cd8-7c44e63467f0 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1470 microversion: 2.1 time: 0.148550 Sep 17 21:07:22.618335 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 211/437] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:22 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:22.935088 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-70b9e3a1-18ce-4411-a04c-cfdd2404290d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:22.935757 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-70b9e3a1-18ce-4411-a04c-cfdd2404290d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:22.945691 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70b9e3a1-18ce-4411-a04c-cfdd2404290d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:22.946871 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70b9e3a1-18ce-4411-a04c-cfdd2404290d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:22.947321 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70b9e3a1-18ce-4411-a04c-cfdd2404290d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:22.948061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70b9e3a1-18ce-4411-a04c-cfdd2404290d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:22.948516 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70b9e3a1-18ce-4411-a04c-cfdd2404290d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:22.949374 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70b9e3a1-18ce-4411-a04c-cfdd2404290d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:22.954077 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:23.081678 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-70b9e3a1-18ce-4411-a04c-cfdd2404290d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:23.089333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-70b9e3a1-18ce-4411-a04c-cfdd2404290d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1370 microversion: 2.1 time: 0.161260 Sep 17 21:07:23.089894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 227/438] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:22 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:23.641058 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-93c3abdb-14b4-49c0-9db6-76368c64e98c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:23.641708 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-93c3abdb-14b4-49c0-9db6-76368c64e98c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:23.648837 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93c3abdb-14b4-49c0-9db6-76368c64e98c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:23.649266 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93c3abdb-14b4-49c0-9db6-76368c64e98c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:23.649704 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93c3abdb-14b4-49c0-9db6-76368c64e98c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:23.650399 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93c3abdb-14b4-49c0-9db6-76368c64e98c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:23.650857 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93c3abdb-14b4-49c0-9db6-76368c64e98c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:23.651282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93c3abdb-14b4-49c0-9db6-76368c64e98c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:23.777910 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-93c3abdb-14b4-49c0-9db6-76368c64e98c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:23.786057 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-93c3abdb-14b4-49c0-9db6-76368c64e98c tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1470 microversion: 2.1 time: 0.148823 Sep 17 21:07:23.786624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 212/439] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:23 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:24.111284 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5bbc310e-3a8f-4261-96db-38c7c04eb125 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:24.112531 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5bbc310e-3a8f-4261-96db-38c7c04eb125 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:24.114398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:24.119609 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bbc310e-3a8f-4261-96db-38c7c04eb125 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:24.120089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bbc310e-3a8f-4261-96db-38c7c04eb125 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:24.120523 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bbc310e-3a8f-4261-96db-38c7c04eb125 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:24.121249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bbc310e-3a8f-4261-96db-38c7c04eb125 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:24.121707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bbc310e-3a8f-4261-96db-38c7c04eb125 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:24.122130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bbc310e-3a8f-4261-96db-38c7c04eb125 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:24.343137 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5bbc310e-3a8f-4261-96db-38c7c04eb125 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:24.351202 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5bbc310e-3a8f-4261-96db-38c7c04eb125 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1370 microversion: 2.1 time: 0.243642 Sep 17 21:07:24.351971 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 228/440] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:24 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:24.809053 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f2e82d0-a11b-40ed-a414-9252029269f8 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:24.809652 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0f2e82d0-a11b-40ed-a414-9252029269f8 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:24.817104 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f2e82d0-a11b-40ed-a414-9252029269f8 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:24.817587 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f2e82d0-a11b-40ed-a414-9252029269f8 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:24.818023 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f2e82d0-a11b-40ed-a414-9252029269f8 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:24.818715 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f2e82d0-a11b-40ed-a414-9252029269f8 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:24.819166 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f2e82d0-a11b-40ed-a414-9252029269f8 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:24.819587 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f2e82d0-a11b-40ed-a414-9252029269f8 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:24.945360 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0f2e82d0-a11b-40ed-a414-9252029269f8 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:24.953568 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0f2e82d0-a11b-40ed-a414-9252029269f8 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1470 microversion: 2.1 time: 0.148663 Sep 17 21:07:24.954130 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 213/441] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:24 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:25.379293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4abb61f0-b882-404e-b07a-935614f3e6f9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:25.381101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4abb61f0-b882-404e-b07a-935614f3e6f9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:25.391728 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7355c7fa-043a-4e1c-9029-d698111b4bd9 req-d5f4c3b1-1f03-4b5e-a52a-339e9a4629f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d", "name": "network-vif-deleted", "tag": "ff080199-aca6-44dd-ab11-21d108f9eb89"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:25.394214 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4abb61f0-b882-404e-b07a-935614f3e6f9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:25.395887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4abb61f0-b882-404e-b07a-935614f3e6f9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:25.396603 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4abb61f0-b882-404e-b07a-935614f3e6f9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:25.397472 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4abb61f0-b882-404e-b07a-935614f3e6f9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:25.398024 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4abb61f0-b882-404e-b07a-935614f3e6f9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:25.398539 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4abb61f0-b882-404e-b07a-935614f3e6f9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:25.423454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7355c7fa-043a-4e1c-9029-d698111b4bd9 req-d5f4c3b1-1f03-4b5e-a52a-339e9a4629f8 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:25.423940 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7355c7fa-043a-4e1c-9029-d698111b4bd9 req-d5f4c3b1-1f03-4b5e-a52a-339e9a4629f8 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:25.427711 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7355c7fa-043a-4e1c-9029-d698111b4bd9 req-d5f4c3b1-1f03-4b5e-a52a-339e9a4629f8 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:25.450810 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7355c7fa-043a-4e1c-9029-d698111b4bd9 req-d5f4c3b1-1f03-4b5e-a52a-339e9a4629f8 service nova] Creating event network-vif-deleted:ff080199-aca6-44dd-ab11-21d108f9eb89 for instance 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d on hv-cinder-82651 Sep 17 21:07:25.456836 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7355c7fa-043a-4e1c-9029-d698111b4bd9 req-d5f4c3b1-1f03-4b5e-a52a-339e9a4629f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075679 Sep 17 21:07:25.457434 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 214/442] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:07:25.558185 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4abb61f0-b882-404e-b07a-935614f3e6f9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:25.565965 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4abb61f0-b882-404e-b07a-935614f3e6f9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1370 microversion: 2.1 time: 0.195601 Sep 17 21:07:25.566519 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 229/443] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:25 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:25.982520 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:25.983218 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:25.989871 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:25.990358 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:25.990791 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:25.991491 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:25.992216 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:25.992660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:26.031051 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:26.031538 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:26.031971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:26.032432 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lazy-loading 'fault' on Instance uuid 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:07:26.038649 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:26.080139 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13e37200d0432788156ae78daaca53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9af3a8a7b3493a817ec028e67f707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:26.088038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dcc4e777-e314-485f-a3b4-5e4d87a9ae11 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 200 len: 1304 microversion: 2.1 time: 0.109861 Sep 17 21:07:26.088598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 215/444] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:25 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:26.588561 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-559f5484-c461-494a-b13c-572f61d3b7b2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:26.589129 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-559f5484-c461-494a-b13c-572f61d3b7b2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:26.590934 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:26.591616 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:26.598195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559f5484-c461-494a-b13c-572f61d3b7b2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:26.598711 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559f5484-c461-494a-b13c-572f61d3b7b2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:26.599151 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559f5484-c461-494a-b13c-572f61d3b7b2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:26.599845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559f5484-c461-494a-b13c-572f61d3b7b2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:26.600303 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559f5484-c461-494a-b13c-572f61d3b7b2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:26.600765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559f5484-c461-494a-b13c-572f61d3b7b2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:26.727098 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-559f5484-c461-494a-b13c-572f61d3b7b2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:26.734927 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-559f5484-c461-494a-b13c-572f61d3b7b2 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1370 microversion: 2.1 time: 0.150279 Sep 17 21:07:26.735475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 230/445] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:26 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:27.111317 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b08a78e0-e8f7-40d3-af6a-32020c0613d7 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:27.111903 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b08a78e0-e8f7-40d3-af6a-32020c0613d7 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] [instance: 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:27.118255 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b08a78e0-e8f7-40d3-af6a-32020c0613d7 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.118735 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b08a78e0-e8f7-40d3-af6a-32020c0613d7 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.119164 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b08a78e0-e8f7-40d3-af6a-32020c0613d7 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.119845 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b08a78e0-e8f7-40d3-af6a-32020c0613d7 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.120298 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b08a78e0-e8f7-40d3-af6a-32020c0613d7 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.120739 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b08a78e0-e8f7-40d3-af6a-32020c0613d7 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.133615 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b08a78e0-e8f7-40d3-af6a-32020c0613d7 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] HTTP exception thrown: Instance 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d could not be found. Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b08a78e0-e8f7-40d3-af6a-32020c0613d7 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Request method failure captured: Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d HTTP/1.1 Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjb14EDuCQuYc_fMQbeVti3RwlXs_5jx2cwJXkNB8_-bSmR-PtUURXawsy9T4fxGNppBjmwVpkeh8cWOo0VsDZokRmjZ4Q1aZIT4nW6t-uuTFD45xqciiUf3BZWhNiOehBxFHH1KuaY171bnXLWzqNL7kS8HLbuGt4Qhe-TnuhMx8Us Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: 7b9af3a8a7b3493a817ec028e67f707f Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesNegativeTest-1063955544 Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:07:27.135257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:07:27.136900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b9af3a8a7b3493a817ec028e67f707f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b9af3a8a7b3493a817ec028e67f707f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b9af3a8a7b3493a817ec028e67f707f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b9af3a8a7b3493a817ec028e67f707f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:07:27.136900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesNegativeTest-1063955544 Sep 17 21:07:27.136900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 7b9af3a8a7b3493a817ec028e67f707f Sep 17 21:07:27.136900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesNegativeTest-1063955544 Sep 17 21:07:27.136900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesNegativeTest-1063955544-project Sep 17 21:07:27.136900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:07:27.136900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:07:27.136900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 9c13e37200d0432788156ae78daaca53 Sep 17 21:07:27.136900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesNegativeTest-1063955544-project Sep 17 21:07:27.136900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:07:27.136900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d could not be found. Sep 17 21:07:27.136900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d'} Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d could not be found. Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:27.137840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d could not be found. Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d could not be found. Sep 17 21:07:27.139282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:07:27.140554 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b08a78e0-e8f7-40d3-af6a-32020c0613d7 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] Returning 404 to user: Instance 21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:27.140554 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b08a78e0-e8f7-40d3-af6a-32020c0613d7 tempest-VolumesNegativeTest-1063955544 tempest-VolumesNegativeTest-1063955544-project] 10.222.0.16 "GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d" status: 404 len: 111 microversion: 2.1 time: 0.029198 Sep 17 21:07:27.140554 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 216/446] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:27 2022] GET /compute/v2.1/servers/21a6b417-cea7-43ab-82b0-c7ab0b7dcb5d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:07:27.757503 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df77a0d9-a7f0-403d-9ca1-b1ea4d566b5f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:27.758121 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-df77a0d9-a7f0-403d-9ca1-b1ea4d566b5f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:27.764119 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df77a0d9-a7f0-403d-9ca1-b1ea4d566b5f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.764723 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df77a0d9-a7f0-403d-9ca1-b1ea4d566b5f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.765808 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df77a0d9-a7f0-403d-9ca1-b1ea4d566b5f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.766719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df77a0d9-a7f0-403d-9ca1-b1ea4d566b5f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.767191 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df77a0d9-a7f0-403d-9ca1-b1ea4d566b5f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.767627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df77a0d9-a7f0-403d-9ca1-b1ea4d566b5f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.915185 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-df77a0d9-a7f0-403d-9ca1-b1ea4d566b5f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:27.922629 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df77a0d9-a7f0-403d-9ca1-b1ea4d566b5f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1370 microversion: 2.1 time: 0.168955 Sep 17 21:07:27.923179 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 231/447] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:27 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:27.962376 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-720e2ef8-9cef-4a4a-81b9-fdf83b70b0f0 req-9fa2ec70-3bc4-4c59-967a-8f6d19fc65d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643a631e-9207-4669-a0bb-623a4a8ebf94", "name": "network-vif-plugged", "status": "completed", "tag": "29f4bfa6-fb19-459c-af27-5bbb69ad95bd"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:27.976922 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-720e2ef8-9cef-4a4a-81b9-fdf83b70b0f0 req-9fa2ec70-3bc4-4c59-967a-8f6d19fc65d2 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.977712 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-720e2ef8-9cef-4a4a-81b9-fdf83b70b0f0 req-9fa2ec70-3bc4-4c59-967a-8f6d19fc65d2 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.978345 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-720e2ef8-9cef-4a4a-81b9-fdf83b70b0f0 req-9fa2ec70-3bc4-4c59-967a-8f6d19fc65d2 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.993284 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-720e2ef8-9cef-4a4a-81b9-fdf83b70b0f0 req-9fa2ec70-3bc4-4c59-967a-8f6d19fc65d2 service nova] Creating event network-vif-plugged:29f4bfa6-fb19-459c-af27-5bbb69ad95bd for instance 643a631e-9207-4669-a0bb-623a4a8ebf94 on hv-cinder-82651 Sep 17 21:07:27.998054 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-720e2ef8-9cef-4a4a-81b9-fdf83b70b0f0 req-9fa2ec70-3bc4-4c59-967a-8f6d19fc65d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040200 Sep 17 21:07:27.998639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 217/448] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:28.946603 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff1b39ad-f42d-4b1d-838b-047ff43f7e97 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:28.947189 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ff1b39ad-f42d-4b1d-838b-047ff43f7e97 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:28.953858 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff1b39ad-f42d-4b1d-838b-047ff43f7e97 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:28.954353 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff1b39ad-f42d-4b1d-838b-047ff43f7e97 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:28.954797 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff1b39ad-f42d-4b1d-838b-047ff43f7e97 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:28.955504 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff1b39ad-f42d-4b1d-838b-047ff43f7e97 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:28.955964 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff1b39ad-f42d-4b1d-838b-047ff43f7e97 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:28.956390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff1b39ad-f42d-4b1d-838b-047ff43f7e97 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:29.098322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff1b39ad-f42d-4b1d-838b-047ff43f7e97 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:29.106366 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff1b39ad-f42d-4b1d-838b-047ff43f7e97 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1370 microversion: 2.1 time: 0.163828 Sep 17 21:07:29.107108 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 232/449] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:28 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:30.129686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74f5f66f-1384-4ac2-9189-8680ed718e9c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:30.130381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-74f5f66f-1384-4ac2-9189-8680ed718e9c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:30.136628 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74f5f66f-1384-4ac2-9189-8680ed718e9c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:30.137146 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74f5f66f-1384-4ac2-9189-8680ed718e9c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:30.137584 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74f5f66f-1384-4ac2-9189-8680ed718e9c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:30.138280 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74f5f66f-1384-4ac2-9189-8680ed718e9c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:30.138737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74f5f66f-1384-4ac2-9189-8680ed718e9c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:30.139319 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74f5f66f-1384-4ac2-9189-8680ed718e9c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:30.276202 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-74f5f66f-1384-4ac2-9189-8680ed718e9c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:30.286137 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-74f5f66f-1384-4ac2-9189-8680ed718e9c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1370 microversion: 2.1 time: 0.161764 Sep 17 21:07:30.286692 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 218/450] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:30 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:31.309427 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7befaccb-9f46-40d8-89a6-3144498b15a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:31.310049 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7befaccb-9f46-40d8-89a6-3144498b15a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:31.315963 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7befaccb-9f46-40d8-89a6-3144498b15a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:31.316511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7befaccb-9f46-40d8-89a6-3144498b15a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:31.316977 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7befaccb-9f46-40d8-89a6-3144498b15a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:31.317758 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7befaccb-9f46-40d8-89a6-3144498b15a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:31.318214 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7befaccb-9f46-40d8-89a6-3144498b15a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:31.318638 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7befaccb-9f46-40d8-89a6-3144498b15a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:31.476860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7befaccb-9f46-40d8-89a6-3144498b15a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:31.484443 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7befaccb-9f46-40d8-89a6-3144498b15a6 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1563 microversion: 2.1 time: 0.178780 Sep 17 21:07:31.485032 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 233/451] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:31 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:31.508151 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87f521d2-53dc-479d-8ecf-077327522cf9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:31.508612 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-87f521d2-53dc-479d-8ecf-077327522cf9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:31.514380 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87f521d2-53dc-479d-8ecf-077327522cf9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:31.514865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87f521d2-53dc-479d-8ecf-077327522cf9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:31.515298 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87f521d2-53dc-479d-8ecf-077327522cf9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:31.515987 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87f521d2-53dc-479d-8ecf-077327522cf9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:31.516440 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87f521d2-53dc-479d-8ecf-077327522cf9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:31.516890 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87f521d2-53dc-479d-8ecf-077327522cf9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:31.597377 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87f521d2-53dc-479d-8ecf-077327522cf9 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093807 Sep 17 21:07:31.599351 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 219/452] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 17 21:07:31 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:32.899905 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-1408d5cf-1beb-4eb1-b8e1-485389cd6b5d req-0a7b8513-b3f5-47d3-ab4f-6b047cf0969c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643a631e-9207-4669-a0bb-623a4a8ebf94", "tag": "29f4bfa6-fb19-459c-af27-5bbb69ad95bd"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:32.910391 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1408d5cf-1beb-4eb1-b8e1-485389cd6b5d req-0a7b8513-b3f5-47d3-ab4f-6b047cf0969c service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:32.910930 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1408d5cf-1beb-4eb1-b8e1-485389cd6b5d req-0a7b8513-b3f5-47d3-ab4f-6b047cf0969c service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:32.911359 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1408d5cf-1beb-4eb1-b8e1-485389cd6b5d req-0a7b8513-b3f5-47d3-ab4f-6b047cf0969c service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:32.922491 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-1408d5cf-1beb-4eb1-b8e1-485389cd6b5d req-0a7b8513-b3f5-47d3-ab4f-6b047cf0969c service nova] Creating event network-changed:29f4bfa6-fb19-459c-af27-5bbb69ad95bd for instance 643a631e-9207-4669-a0bb-623a4a8ebf94 on hv-cinder-82651 Sep 17 21:07:32.928254 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-1408d5cf-1beb-4eb1-b8e1-485389cd6b5d req-0a7b8513-b3f5-47d3-ab4f-6b047cf0969c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032046 Sep 17 21:07:32.929067 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 234/453] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:41.512600 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=23 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:41.522472 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3274a493-accf-45d1-a8d9-28cfad976f4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Action: 'create', calling method: .version_select at 0x7f9ba7602a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-446168923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGs4cYl3ST+/a3EmVVFdDka+fYsqMYaMfGGviHNDP5XJez5Bis/3KW/5UL4v97pQyM7TfIgrMy9eQNWTDgAQJBiOL2X1CF+ybjKX7fZO3lJkzfzKJk5k7jPxL8ROgdIfw=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:41.537576 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=62 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:41.540029 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-3274a493-accf-45d1-a8d9-28cfad976f4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Getting quotas for project 36c930f8134548e393831a0ef4034ea9. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:07:41.544448 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-3274a493-accf-45d1-a8d9-28cfad976f4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Getting quotas for user c829f155714140bb87a78429d4e50af3 and project 36c930f8134548e393831a0ef4034ea9. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:07:41.567554 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3274a493-accf-45d1-a8d9-28cfad976f4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.220471 Sep 17 21:07:41.568071 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 220/454] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 17 21:07:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:54.499578 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=13 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:54.500302 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=42 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:54.504798 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a34a944-720c-4381-a15c-07dd42788e65 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:54.505381 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a34a944-720c-4381-a15c-07dd42788e65 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:54.513121 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a34a944-720c-4381-a15c-07dd42788e65 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:54.513607 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a34a944-720c-4381-a15c-07dd42788e65 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:54.514039 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a34a944-720c-4381-a15c-07dd42788e65 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:54.514725 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a34a944-720c-4381-a15c-07dd42788e65 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:54.515178 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a34a944-720c-4381-a15c-07dd42788e65 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:54.515600 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a34a944-720c-4381-a15c-07dd42788e65 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:54.538128 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9a34a944-720c-4381-a15c-07dd42788e65 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e/ips" status: 200 len: 148 microversion: 2.1 time: 0.039675 Sep 17 21:07:54.538688 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 235/455] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 17 21:07:54 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:56.840371 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:56.841220 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:56.846704 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3561b065-d993-4d87-8256-f5d9bc9cc611 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:56.847214 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3561b065-d993-4d87-8256-f5d9bc9cc611 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:56.857035 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3561b065-d993-4d87-8256-f5d9bc9cc611 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:56.857517 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3561b065-d993-4d87-8256-f5d9bc9cc611 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:56.857946 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3561b065-d993-4d87-8256-f5d9bc9cc611 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:56.858633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3561b065-d993-4d87-8256-f5d9bc9cc611 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:56.859080 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3561b065-d993-4d87-8256-f5d9bc9cc611 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:56.859501 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3561b065-d993-4d87-8256-f5d9bc9cc611 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:56.883236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3561b065-d993-4d87-8256-f5d9bc9cc611 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/ips" status: 200 len: 145 microversion: 2.1 time: 0.044429 Sep 17 21:07:56.884049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 221/456] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 17 21:07:56 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:56.960037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e3ca415-b1d0-4418-aadd-01aad70c9262 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8db2f702-d972-4d65-aab0-8f20e347d8b7"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:56.962390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e3ca415-b1d0-4418-aadd-01aad70c9262 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:56.968285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e3ca415-b1d0-4418-aadd-01aad70c9262 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:56.968795 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e3ca415-b1d0-4418-aadd-01aad70c9262 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:56.969260 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e3ca415-b1d0-4418-aadd-01aad70c9262 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:56.969950 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e3ca415-b1d0-4418-aadd-01aad70c9262 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:56.970405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e3ca415-b1d0-4418-aadd-01aad70c9262 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:56.970825 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e3ca415-b1d0-4418-aadd-01aad70c9262 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:57.236165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e3ca415-b1d0-4418-aadd-01aad70c9262 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280436 Sep 17 21:07:57.236787 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 236/457] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:07:56 2022] POST /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:59.663982 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2ead23a-5fd0-4a5b-8228-fa5d0385574b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "722ff35c-3826-4341-84ca-71bce5beeac8"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:59.666612 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2ead23a-5fd0-4a5b-8228-fa5d0385574b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:59.672971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ead23a-5fd0-4a5b-8228-fa5d0385574b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:59.673461 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ead23a-5fd0-4a5b-8228-fa5d0385574b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:59.673898 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ead23a-5fd0-4a5b-8228-fa5d0385574b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:59.674616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ead23a-5fd0-4a5b-8228-fa5d0385574b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:59.675073 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ead23a-5fd0-4a5b-8228-fa5d0385574b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:59.675507 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ead23a-5fd0-4a5b-8228-fa5d0385574b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:59.910183 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2ead23a-5fd0-4a5b-8228-fa5d0385574b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "POST /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250256 Sep 17 21:07:59.911098 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 222/458] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:07:59 2022] POST /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:04.779786 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a777ec6d-f1b9-41eb-a0c9-de1a12408bac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: .version_select at 0x7f9ba75e9f70>, body: {"keypair": {"name": "tempest-keypair-538995622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ4v3uK5kd6r8jwML3Q38PJ4wAkq9Ul8iEvvqKppAXHu5KQWhXjb3WpUCe6JAaSJJ3hsKcyEDM5Oo8ZTtJoWiAHGNxEEvsTIc1IhVqgKz9TeIi+FC4PaZPbisK2Lrs5Ow=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:04.795967 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-a777ec6d-f1b9-41eb-a0c9-de1a12408bac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for project d9689fd1a04647cf91a73680e4b677d1. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:08:04.799725 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-a777ec6d-f1b9-41eb-a0c9-de1a12408bac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for user 1e3b1e0f4888400b89c47b3e44443228 and project d9689fd1a04647cf91a73680e4b677d1. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:08:04.821039 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a777ec6d-f1b9-41eb-a0c9-de1a12408bac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046077 Sep 17 21:08:04.821599 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 237/459] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 17 21:08:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:06.080074 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1802721660", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2c320a7-411d-4280-a740-e3d2f3da6961"}], "security_groups": [{"name": "tempest-securitygroup--1593347489"}], "key_name": "tempest-keypair-538995622", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:06.185290 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] validate_networks() for [('b2c320a7-411d-4280-a740-e3d2f3da6961', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:08:06.560350 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:08:06.560875 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:08:06.561339 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:08:06.561742 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:08:06.562145 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:08:06.570951 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:06.571422 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:06.571852 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:06.572566 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:06.573048 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:06.573467 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:06.590194 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for project d9689fd1a04647cf91a73680e4b677d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:08:06.594061 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for user 1e3b1e0f4888400b89c47b3e44443228 and project d9689fd1a04647cf91a73680e4b677d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:08:06.605311 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:08:06.607664 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:08:06.654525 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c186b3c-d956-479d-a8ca-ed166af99be3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.579494 Sep 17 21:08:06.655155 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 223/460] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:08:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:08:06.667472 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f76f91e6-eed8-41b3-a3d8-77da36c1b1d6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:06.668203 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f76f91e6-eed8-41b3-a3d8-77da36c1b1d6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:06.725123 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f76f91e6-eed8-41b3-a3d8-77da36c1b1d6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:06.731985 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f76f91e6-eed8-41b3-a3d8-77da36c1b1d6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1241 microversion: 2.1 time: 0.068771 Sep 17 21:08:06.732906 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 238/461] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:06 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:07.755359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bdb75fd7-d7b6-405e-9a25-c51f8267fa5e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:07.755966 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bdb75fd7-d7b6-405e-9a25-c51f8267fa5e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:07.762273 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdb75fd7-d7b6-405e-9a25-c51f8267fa5e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:07.762753 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdb75fd7-d7b6-405e-9a25-c51f8267fa5e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:07.763184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdb75fd7-d7b6-405e-9a25-c51f8267fa5e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:07.763871 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdb75fd7-d7b6-405e-9a25-c51f8267fa5e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:07.764318 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdb75fd7-d7b6-405e-9a25-c51f8267fa5e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:07.764769 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdb75fd7-d7b6-405e-9a25-c51f8267fa5e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:07.828376 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bdb75fd7-d7b6-405e-9a25-c51f8267fa5e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:07.836047 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bdb75fd7-d7b6-405e-9a25-c51f8267fa5e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1293 microversion: 2.1 time: 0.085067 Sep 17 21:08:07.836654 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 224/462] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:07 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:08.415909 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1373734746", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-446168923", "security_groups": [{"name": "tempest-secgroup-smoke-1970775688"}], "networks": [{"uuid": "94010469-2233-40f2-8cb2-c8a1dc7dcd7f"}], "block_device_mapping_v2": [{"uuid": "9b38c524-2b35-47ec-9d0e-480a334a8e9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:08.429524 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:08.602596 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] validate_networks() for [('94010469-2233-40f2-8cb2-c8a1dc7dcd7f', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:08:08.859404 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b102805-040c-467e-9b91-04fd95c7bc1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:08.860017 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b102805-040c-467e-9b91-04fd95c7bc1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:08.867055 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b102805-040c-467e-9b91-04fd95c7bc1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:08.867544 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b102805-040c-467e-9b91-04fd95c7bc1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:08.867977 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b102805-040c-467e-9b91-04fd95c7bc1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:08.868668 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b102805-040c-467e-9b91-04fd95c7bc1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:08.869149 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b102805-040c-467e-9b91-04fd95c7bc1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:08.869572 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b102805-040c-467e-9b91-04fd95c7bc1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:09.402334 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b102805-040c-467e-9b91-04fd95c7bc1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:09.409916 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b102805-040c-467e-9b91-04fd95c7bc1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1367 microversion: 2.1 time: 0.554402 Sep 17 21:08:09.410468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 225/463] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:08 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1367 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:09.572442 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:08:09.573041 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:08:09.573357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:08:09.573759 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:08:09.574168 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:08:09.583379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:09.583866 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:09.584299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:09.585056 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:09.585511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:09.585932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:09.603511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Getting quotas for project 36c930f8134548e393831a0ef4034ea9. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:08:09.607482 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Getting quotas for user c829f155714140bb87a78429d4e50af3 and project 36c930f8134548e393831a0ef4034ea9. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:08:09.665613 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:08:09.667737 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b38c524-2b35-47ec-9d0e-480a334a8e9a',volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:08:09.802323 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9a2c219f-93c9-479a-a401-d18c55db4068 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.389632 Sep 17 21:08:09.803502 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 239/464] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:08:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:08:09.816934 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3535276b-a4b8-4d75-a844-a9158cc3e322 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:09.818061 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3535276b-a4b8-4d75-a844-a9158cc3e322 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:09.818759 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2460ec39-5e05-4e57-b6e5-bd7a05f01e93 req-85490861-922f-49ae-9e52-0e63ef4ae672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33fe9079-6aa4-43be-b5d0-8f5df95a890e", "tag": "8194fc95-84a0-4a89-b5d3-4e1533b9ce62"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:09.834759 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2460ec39-5e05-4e57-b6e5-bd7a05f01e93 req-85490861-922f-49ae-9e52-0e63ef4ae672 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:09.835316 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2460ec39-5e05-4e57-b6e5-bd7a05f01e93 req-85490861-922f-49ae-9e52-0e63ef4ae672 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:09.835813 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2460ec39-5e05-4e57-b6e5-bd7a05f01e93 req-85490861-922f-49ae-9e52-0e63ef4ae672 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:09.846985 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2460ec39-5e05-4e57-b6e5-bd7a05f01e93 req-85490861-922f-49ae-9e52-0e63ef4ae672 service nova] Creating event network-changed:8194fc95-84a0-4a89-b5d3-4e1533b9ce62 for instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e on hv-cinder-82651 Sep 17 21:08:09.852209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2460ec39-5e05-4e57-b6e5-bd7a05f01e93 req-85490861-922f-49ae-9e52-0e63ef4ae672 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038534 Sep 17 21:08:09.853223 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 240/465] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:08:09.916754 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3535276b-a4b8-4d75-a844-a9158cc3e322 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:09.923508 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3535276b-a4b8-4d75-a844-a9158cc3e322 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1088 microversion: 2.1 time: 0.112582 Sep 17 21:08:09.924070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 226/466] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:09 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1088 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:10.436364 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5bd426cf-a810-4047-a199-f864fa00ad74 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:10.437064 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5bd426cf-a810-4047-a199-f864fa00ad74 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:10.443765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd426cf-a810-4047-a199-f864fa00ad74 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:10.444246 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd426cf-a810-4047-a199-f864fa00ad74 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:10.444989 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd426cf-a810-4047-a199-f864fa00ad74 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:10.445690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd426cf-a810-4047-a199-f864fa00ad74 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:10.446147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd426cf-a810-4047-a199-f864fa00ad74 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:10.446573 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd426cf-a810-4047-a199-f864fa00ad74 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:10.614768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5bd426cf-a810-4047-a199-f864fa00ad74 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:10.622333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5bd426cf-a810-4047-a199-f864fa00ad74 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1367 microversion: 2.1 time: 0.190716 Sep 17 21:08:10.622890 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 241/467] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:10 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:10.946853 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4273f53-f341-4f14-b4e2-19a9df1321c0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:10.947469 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e4273f53-f341-4f14-b4e2-19a9df1321c0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:10.958733 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4273f53-f341-4f14-b4e2-19a9df1321c0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:10.959506 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4273f53-f341-4f14-b4e2-19a9df1321c0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:10.959968 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4273f53-f341-4f14-b4e2-19a9df1321c0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:10.960716 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4273f53-f341-4f14-b4e2-19a9df1321c0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:10.961165 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4273f53-f341-4f14-b4e2-19a9df1321c0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:10.961589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4273f53-f341-4f14-b4e2-19a9df1321c0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:11.083459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4273f53-f341-4f14-b4e2-19a9df1321c0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:11.093543 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4273f53-f341-4f14-b4e2-19a9df1321c0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1130 microversion: 2.1 time: 0.150701 Sep 17 21:08:11.094424 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 227/468] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:10 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1130 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:11.645374 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe17ad4c-bcb3-4862-a25b-f2163e477703 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:11.645982 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fe17ad4c-bcb3-4862-a25b-f2163e477703 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:11.653101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe17ad4c-bcb3-4862-a25b-f2163e477703 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:11.653578 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe17ad4c-bcb3-4862-a25b-f2163e477703 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:11.654006 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe17ad4c-bcb3-4862-a25b-f2163e477703 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:11.654734 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe17ad4c-bcb3-4862-a25b-f2163e477703 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:11.655186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe17ad4c-bcb3-4862-a25b-f2163e477703 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:11.655623 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe17ad4c-bcb3-4862-a25b-f2163e477703 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:11.723453 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-018a1f66-370c-460d-bc59-28cd30b0a82d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:11.729525 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-018a1f66-370c-460d-bc59-28cd30b0a82d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:11.739109 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-018a1f66-370c-460d-bc59-28cd30b0a82d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:11.739616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-018a1f66-370c-460d-bc59-28cd30b0a82d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:11.800947 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-018a1f66-370c-460d-bc59-28cd30b0a82d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Going to try to stop instance {{(pid=120588) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 21:08:11.839681 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe17ad4c-bcb3-4862-a25b-f2163e477703 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:11.848697 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe17ad4c-bcb3-4862-a25b-f2163e477703 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1367 microversion: 2.1 time: 0.207201 Sep 17 21:08:11.849311 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 242/469] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:11 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:11.869797 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-018a1f66-370c-460d-bc59-28cd30b0a82d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "POST /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/action" status: 202 len: 0 microversion: 2.1 time: 0.149112 Sep 17 21:08:11.870512 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 228/470] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:08:11 2022] POST /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:08:11.879102 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-acd92a13-992d-4cbb-83cc-611fb2663651 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:11.879960 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-acd92a13-992d-4cbb-83cc-611fb2663651 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:11.887126 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acd92a13-992d-4cbb-83cc-611fb2663651 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:11.887925 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acd92a13-992d-4cbb-83cc-611fb2663651 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:11.888531 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acd92a13-992d-4cbb-83cc-611fb2663651 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:11.889552 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acd92a13-992d-4cbb-83cc-611fb2663651 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:11.890158 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acd92a13-992d-4cbb-83cc-611fb2663651 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:11.890738 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acd92a13-992d-4cbb-83cc-611fb2663651 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:12.117858 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-acd92a13-992d-4cbb-83cc-611fb2663651 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:12.119499 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7501e76f-8d62-46b5-98d2-5775058bab30 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:12.120255 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7501e76f-8d62-46b5-98d2-5775058bab30 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:12.127941 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7501e76f-8d62-46b5-98d2-5775058bab30 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:12.128714 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7501e76f-8d62-46b5-98d2-5775058bab30 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:12.129242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7501e76f-8d62-46b5-98d2-5775058bab30 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:12.130022 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7501e76f-8d62-46b5-98d2-5775058bab30 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:12.130535 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7501e76f-8d62-46b5-98d2-5775058bab30 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:12.131221 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7501e76f-8d62-46b5-98d2-5775058bab30 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:12.134891 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-acd92a13-992d-4cbb-83cc-611fb2663651 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1723 microversion: 2.1 time: 0.259867 Sep 17 21:08:12.135505 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 243/471] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:11 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:12.195152 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7501e76f-8d62-46b5-98d2-5775058bab30 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:12.202789 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7501e76f-8d62-46b5-98d2-5775058bab30 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1204 microversion: 2.1 time: 0.088691 Sep 17 21:08:12.203355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 229/472] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:12 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1204 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:12.872081 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b1bc426-51dd-464b-9dd8-706f6a2a10e9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:12.872630 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b1bc426-51dd-464b-9dd8-706f6a2a10e9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:12.878993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1bc426-51dd-464b-9dd8-706f6a2a10e9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:12.879474 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1bc426-51dd-464b-9dd8-706f6a2a10e9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:12.879904 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1bc426-51dd-464b-9dd8-706f6a2a10e9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:12.880597 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1bc426-51dd-464b-9dd8-706f6a2a10e9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:12.881075 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1bc426-51dd-464b-9dd8-706f6a2a10e9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:12.881496 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1bc426-51dd-464b-9dd8-706f6a2a10e9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:13.010334 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b1bc426-51dd-464b-9dd8-706f6a2a10e9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:13.017911 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b1bc426-51dd-464b-9dd8-706f6a2a10e9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1367 microversion: 2.1 time: 0.149697 Sep 17 21:08:13.018465 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 244/473] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:12 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:13.158325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c054f2b-4df0-41e5-8552-7f4318be208d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:13.158925 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c054f2b-4df0-41e5-8552-7f4318be208d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:13.165869 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c054f2b-4df0-41e5-8552-7f4318be208d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:13.166343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c054f2b-4df0-41e5-8552-7f4318be208d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:13.166768 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c054f2b-4df0-41e5-8552-7f4318be208d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:13.167449 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c054f2b-4df0-41e5-8552-7f4318be208d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:13.167912 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c054f2b-4df0-41e5-8552-7f4318be208d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:13.168313 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c054f2b-4df0-41e5-8552-7f4318be208d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:13.227611 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd8cac05-fd9c-4a76-a647-c16182811c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:13.228468 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cd8cac05-fd9c-4a76-a647-c16182811c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:13.235026 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd8cac05-fd9c-4a76-a647-c16182811c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:13.235509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd8cac05-fd9c-4a76-a647-c16182811c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:13.235946 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd8cac05-fd9c-4a76-a647-c16182811c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:13.236635 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd8cac05-fd9c-4a76-a647-c16182811c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:13.237186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd8cac05-fd9c-4a76-a647-c16182811c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:13.237631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd8cac05-fd9c-4a76-a647-c16182811c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:13.339855 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c054f2b-4df0-41e5-8552-7f4318be208d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:13.348248 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c054f2b-4df0-41e5-8552-7f4318be208d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1723 microversion: 2.1 time: 0.193700 Sep 17 21:08:13.348840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 230/474] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:13 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:13.390619 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cd8cac05-fd9c-4a76-a647-c16182811c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:13.398835 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd8cac05-fd9c-4a76-a647-c16182811c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1272 microversion: 2.1 time: 0.175632 Sep 17 21:08:13.399384 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 245/475] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:13 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:14.040870 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98c4d1de-dd7a-406f-b83b-d3d9b4a0e053 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:14.041500 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98c4d1de-dd7a-406f-b83b-d3d9b4a0e053 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:14.047386 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98c4d1de-dd7a-406f-b83b-d3d9b4a0e053 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:14.047872 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98c4d1de-dd7a-406f-b83b-d3d9b4a0e053 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:14.048305 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98c4d1de-dd7a-406f-b83b-d3d9b4a0e053 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:14.049059 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98c4d1de-dd7a-406f-b83b-d3d9b4a0e053 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:14.049517 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98c4d1de-dd7a-406f-b83b-d3d9b4a0e053 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:14.049948 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98c4d1de-dd7a-406f-b83b-d3d9b4a0e053 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:14.174865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-98c4d1de-dd7a-406f-b83b-d3d9b4a0e053 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:14.183934 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98c4d1de-dd7a-406f-b83b-d3d9b4a0e053 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1367 microversion: 2.1 time: 0.147269 Sep 17 21:08:14.184524 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 231/476] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:14 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:14.375200 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4c65139-0352-4440-9c97-82cac87781a1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:14.375200 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4c65139-0352-4440-9c97-82cac87781a1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:14.379344 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4c65139-0352-4440-9c97-82cac87781a1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:14.379768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4c65139-0352-4440-9c97-82cac87781a1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:14.380203 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4c65139-0352-4440-9c97-82cac87781a1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:14.381172 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4c65139-0352-4440-9c97-82cac87781a1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:14.381667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4c65139-0352-4440-9c97-82cac87781a1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:14.382093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4c65139-0352-4440-9c97-82cac87781a1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:14.420806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d793a183-20b1-460a-88ab-0a4bb268924b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:14.421518 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d793a183-20b1-460a-88ab-0a4bb268924b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:14.428459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d793a183-20b1-460a-88ab-0a4bb268924b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:14.429038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d793a183-20b1-460a-88ab-0a4bb268924b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:14.429510 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d793a183-20b1-460a-88ab-0a4bb268924b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:14.430252 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d793a183-20b1-460a-88ab-0a4bb268924b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:14.430715 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d793a183-20b1-460a-88ab-0a4bb268924b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:14.431300 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d793a183-20b1-460a-88ab-0a4bb268924b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:14.566734 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4c65139-0352-4440-9c97-82cac87781a1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:14.575579 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4c65139-0352-4440-9c97-82cac87781a1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1723 microversion: 2.1 time: 0.207548 Sep 17 21:08:14.576150 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 246/477] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:14 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:14.597081 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d793a183-20b1-460a-88ab-0a4bb268924b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:14.605226 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d793a183-20b1-460a-88ab-0a4bb268924b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1272 microversion: 2.1 time: 0.188272 Sep 17 21:08:14.605786 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 232/478] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:14 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:15.212124 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b714c01c-6585-4b0e-9249-5d4cfa4b5a90 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:15.217861 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b714c01c-6585-4b0e-9249-5d4cfa4b5a90 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:15.227565 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b714c01c-6585-4b0e-9249-5d4cfa4b5a90 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:15.228323 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b714c01c-6585-4b0e-9249-5d4cfa4b5a90 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:15.228861 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b714c01c-6585-4b0e-9249-5d4cfa4b5a90 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:15.229614 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b714c01c-6585-4b0e-9249-5d4cfa4b5a90 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:15.230068 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b714c01c-6585-4b0e-9249-5d4cfa4b5a90 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:15.230517 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b714c01c-6585-4b0e-9249-5d4cfa4b5a90 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:15.369880 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b714c01c-6585-4b0e-9249-5d4cfa4b5a90 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:15.378282 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b714c01c-6585-4b0e-9249-5d4cfa4b5a90 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1367 microversion: 2.1 time: 0.174788 Sep 17 21:08:15.379606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 247/479] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:15 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:15.448902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-bd793bea-952b-4f33-91aa-e431a15f0f93 req-d9f0af2e-cc76-4a55-8888-a8594b2114e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3209ceff-722f-437e-9ece-3f9542c1daa7", "tag": "9ec72a7a-4fab-4ddb-9a94-b4581d132104"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:15.461946 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bd793bea-952b-4f33-91aa-e431a15f0f93 req-d9f0af2e-cc76-4a55-8888-a8594b2114e0 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:15.462525 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bd793bea-952b-4f33-91aa-e431a15f0f93 req-d9f0af2e-cc76-4a55-8888-a8594b2114e0 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:15.463033 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bd793bea-952b-4f33-91aa-e431a15f0f93 req-d9f0af2e-cc76-4a55-8888-a8594b2114e0 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:15.474894 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-bd793bea-952b-4f33-91aa-e431a15f0f93 req-d9f0af2e-cc76-4a55-8888-a8594b2114e0 service nova] Creating event network-changed:9ec72a7a-4fab-4ddb-9a94-b4581d132104 for instance 3209ceff-722f-437e-9ece-3f9542c1daa7 on hv-cinder-82651 Sep 17 21:08:15.480621 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-bd793bea-952b-4f33-91aa-e431a15f0f93 req-d9f0af2e-cc76-4a55-8888-a8594b2114e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036769 Sep 17 21:08:15.481331 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 233/480] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:15.598291 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d69fe741-53d9-47e6-ae57-bdda0b6d2985 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:15.599003 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d69fe741-53d9-47e6-ae57-bdda0b6d2985 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:15.605006 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d69fe741-53d9-47e6-ae57-bdda0b6d2985 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:15.605568 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d69fe741-53d9-47e6-ae57-bdda0b6d2985 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:15.606079 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d69fe741-53d9-47e6-ae57-bdda0b6d2985 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:15.606786 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d69fe741-53d9-47e6-ae57-bdda0b6d2985 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:15.607242 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d69fe741-53d9-47e6-ae57-bdda0b6d2985 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:15.607667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d69fe741-53d9-47e6-ae57-bdda0b6d2985 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:15.627728 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fb7b8350-2b47-41af-88bd-fb379b76bd9e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:15.628422 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fb7b8350-2b47-41af-88bd-fb379b76bd9e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:15.635411 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7b8350-2b47-41af-88bd-fb379b76bd9e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:15.635895 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7b8350-2b47-41af-88bd-fb379b76bd9e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:15.636327 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7b8350-2b47-41af-88bd-fb379b76bd9e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:15.637057 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7b8350-2b47-41af-88bd-fb379b76bd9e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:15.637511 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7b8350-2b47-41af-88bd-fb379b76bd9e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:15.639184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7b8350-2b47-41af-88bd-fb379b76bd9e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:15.794879 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d69fe741-53d9-47e6-ae57-bdda0b6d2985 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:15.804031 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d69fe741-53d9-47e6-ae57-bdda0b6d2985 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1723 microversion: 2.1 time: 0.209547 Sep 17 21:08:15.804536 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 248/481] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:15 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:15.827627 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fb7b8350-2b47-41af-88bd-fb379b76bd9e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:15.835260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fb7b8350-2b47-41af-88bd-fb379b76bd9e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.211632 Sep 17 21:08:15.835817 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 234/482] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:15 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:16.401497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff92502e-0029-4dca-820c-a1c468eada09 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:16.402274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ff92502e-0029-4dca-820c-a1c468eada09 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:16.408609 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff92502e-0029-4dca-820c-a1c468eada09 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:16.409122 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff92502e-0029-4dca-820c-a1c468eada09 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:16.409556 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff92502e-0029-4dca-820c-a1c468eada09 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:16.410248 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff92502e-0029-4dca-820c-a1c468eada09 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:16.410706 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff92502e-0029-4dca-820c-a1c468eada09 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:16.411129 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff92502e-0029-4dca-820c-a1c468eada09 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:16.540560 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff92502e-0029-4dca-820c-a1c468eada09 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:16.548298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff92502e-0029-4dca-820c-a1c468eada09 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1367 microversion: 2.1 time: 0.150673 Sep 17 21:08:16.548889 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 249/483] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:16 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:16.828393 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c4793a0e-8b15-48a4-9f31-4176d58ac0b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:16.829055 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4793a0e-8b15-48a4-9f31-4176d58ac0b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:16.831745 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:16.838128 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4793a0e-8b15-48a4-9f31-4176d58ac0b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:16.838621 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4793a0e-8b15-48a4-9f31-4176d58ac0b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:16.839068 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4793a0e-8b15-48a4-9f31-4176d58ac0b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:16.839792 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4793a0e-8b15-48a4-9f31-4176d58ac0b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:16.840383 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4793a0e-8b15-48a4-9f31-4176d58ac0b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:16.840847 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4793a0e-8b15-48a4-9f31-4176d58ac0b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:16.858544 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e4cec2c4-e31d-4b70-b50c-58ae6d2678e9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:16.859300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e4cec2c4-e31d-4b70-b50c-58ae6d2678e9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:16.866842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4cec2c4-e31d-4b70-b50c-58ae6d2678e9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:16.867428 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4cec2c4-e31d-4b70-b50c-58ae6d2678e9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:16.867937 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4cec2c4-e31d-4b70-b50c-58ae6d2678e9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:16.869889 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4cec2c4-e31d-4b70-b50c-58ae6d2678e9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:16.870089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4cec2c4-e31d-4b70-b50c-58ae6d2678e9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:16.870588 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4cec2c4-e31d-4b70-b50c-58ae6d2678e9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:17.054198 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c4793a0e-8b15-48a4-9f31-4176d58ac0b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:17.058616 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e4cec2c4-e31d-4b70-b50c-58ae6d2678e9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:17.063092 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c4793a0e-8b15-48a4-9f31-4176d58ac0b8 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1723 microversion: 2.1 time: 0.238765 Sep 17 21:08:17.063738 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 235/484] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:16 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:17.066180 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e4cec2c4-e31d-4b70-b50c-58ae6d2678e9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.211527 Sep 17 21:08:17.066731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 250/485] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:16 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:17.571458 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0aca1034-2948-4cc4-819b-0a70213003dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:17.571987 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0aca1034-2948-4cc4-819b-0a70213003dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:17.577842 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aca1034-2948-4cc4-819b-0a70213003dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:17.578326 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aca1034-2948-4cc4-819b-0a70213003dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:17.578758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aca1034-2948-4cc4-819b-0a70213003dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:17.579444 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aca1034-2948-4cc4-819b-0a70213003dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:17.579894 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aca1034-2948-4cc4-819b-0a70213003dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:17.580315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aca1034-2948-4cc4-819b-0a70213003dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:17.709863 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0aca1034-2948-4cc4-819b-0a70213003dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:17.717450 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0aca1034-2948-4cc4-819b-0a70213003dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1367 microversion: 2.1 time: 0.150180 Sep 17 21:08:17.718006 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 236/486] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:17 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:18.087699 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7def0d62-858c-4176-87f0-7fe2da642898 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:18.088226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7def0d62-858c-4176-87f0-7fe2da642898 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:18.089760 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e816bdca-ac7e-4ec1-b686-37aa88c94b1b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:18.090880 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e816bdca-ac7e-4ec1-b686-37aa88c94b1b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:18.094946 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7def0d62-858c-4176-87f0-7fe2da642898 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:18.095427 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7def0d62-858c-4176-87f0-7fe2da642898 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:18.096022 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7def0d62-858c-4176-87f0-7fe2da642898 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:18.096844 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7def0d62-858c-4176-87f0-7fe2da642898 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:18.097254 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7def0d62-858c-4176-87f0-7fe2da642898 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:18.097615 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7def0d62-858c-4176-87f0-7fe2da642898 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:18.097810 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e816bdca-ac7e-4ec1-b686-37aa88c94b1b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:18.098320 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e816bdca-ac7e-4ec1-b686-37aa88c94b1b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:18.098808 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e816bdca-ac7e-4ec1-b686-37aa88c94b1b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:18.100385 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e816bdca-ac7e-4ec1-b686-37aa88c94b1b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:18.101279 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e816bdca-ac7e-4ec1-b686-37aa88c94b1b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:18.101710 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e816bdca-ac7e-4ec1-b686-37aa88c94b1b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:18.321032 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7def0d62-858c-4176-87f0-7fe2da642898 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:18.324641 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e816bdca-ac7e-4ec1-b686-37aa88c94b1b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:18.328113 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:18.329403 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7def0d62-858c-4176-87f0-7fe2da642898 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1723 microversion: 2.1 time: 0.246137 Sep 17 21:08:18.330153 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 251/487] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:18 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:18.334416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e816bdca-ac7e-4ec1-b686-37aa88c94b1b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.247837 Sep 17 21:08:18.335136 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 237/488] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:18 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:18.335283 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-88463f7a-cac0-4bea-a984-0d95a2a1ccac req-e7f9f827-9d48-4a3b-81fd-6536acc7542e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33fe9079-6aa4-43be-b5d0-8f5df95a890e", "name": "network-vif-plugged", "status": "completed", "tag": "8194fc95-84a0-4a89-b5d3-4e1533b9ce62"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:18.344574 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-88463f7a-cac0-4bea-a984-0d95a2a1ccac req-e7f9f827-9d48-4a3b-81fd-6536acc7542e service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:18.345029 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-88463f7a-cac0-4bea-a984-0d95a2a1ccac req-e7f9f827-9d48-4a3b-81fd-6536acc7542e service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:18.345461 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-88463f7a-cac0-4bea-a984-0d95a2a1ccac req-e7f9f827-9d48-4a3b-81fd-6536acc7542e service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:18.355988 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-88463f7a-cac0-4bea-a984-0d95a2a1ccac req-e7f9f827-9d48-4a3b-81fd-6536acc7542e service nova] Creating event network-vif-plugged:8194fc95-84a0-4a89-b5d3-4e1533b9ce62 for instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e on hv-cinder-82651 Sep 17 21:08:18.361128 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-88463f7a-cac0-4bea-a984-0d95a2a1ccac req-e7f9f827-9d48-4a3b-81fd-6536acc7542e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029787 Sep 17 21:08:18.361812 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 252/489] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:18.740036 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58ffffb7-fa88-4df2-816d-fd2757c36fe8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:18.740626 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-58ffffb7-fa88-4df2-816d-fd2757c36fe8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:18.747565 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58ffffb7-fa88-4df2-816d-fd2757c36fe8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:18.748044 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58ffffb7-fa88-4df2-816d-fd2757c36fe8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:18.748472 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58ffffb7-fa88-4df2-816d-fd2757c36fe8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:18.749173 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58ffffb7-fa88-4df2-816d-fd2757c36fe8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:18.749622 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58ffffb7-fa88-4df2-816d-fd2757c36fe8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:18.750042 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58ffffb7-fa88-4df2-816d-fd2757c36fe8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:18.876374 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-58ffffb7-fa88-4df2-816d-fd2757c36fe8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:18.884109 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-58ffffb7-fa88-4df2-816d-fd2757c36fe8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1367 microversion: 2.1 time: 0.148409 Sep 17 21:08:18.884657 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 238/490] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:18 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:19.354751 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fba25431-67bf-410a-9267-972c2bb1fefe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.355442 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fba25431-67bf-410a-9267-972c2bb1fefe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:19.357443 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1ab50755-6a3d-4ae6-8f74-5cfe1cbf26ca tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.358160 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1ab50755-6a3d-4ae6-8f74-5cfe1cbf26ca tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:19.361540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba25431-67bf-410a-9267-972c2bb1fefe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:19.362023 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba25431-67bf-410a-9267-972c2bb1fefe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:19.362459 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba25431-67bf-410a-9267-972c2bb1fefe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:19.363149 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba25431-67bf-410a-9267-972c2bb1fefe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:19.363598 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba25431-67bf-410a-9267-972c2bb1fefe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:19.364015 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba25431-67bf-410a-9267-972c2bb1fefe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:19.364367 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ab50755-6a3d-4ae6-8f74-5cfe1cbf26ca tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:19.365054 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ab50755-6a3d-4ae6-8f74-5cfe1cbf26ca tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:19.365488 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ab50755-6a3d-4ae6-8f74-5cfe1cbf26ca tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:19.366179 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ab50755-6a3d-4ae6-8f74-5cfe1cbf26ca tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:19.366634 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ab50755-6a3d-4ae6-8f74-5cfe1cbf26ca tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:19.367067 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ab50755-6a3d-4ae6-8f74-5cfe1cbf26ca tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:19.560575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fba25431-67bf-410a-9267-972c2bb1fefe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:19.564933 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ab50755-6a3d-4ae6-8f74-5cfe1cbf26ca tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:19.568987 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fba25431-67bf-410a-9267-972c2bb1fefe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1723 microversion: 2.1 time: 0.218771 Sep 17 21:08:19.569880 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 253/491] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:19 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:19.573191 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1ab50755-6a3d-4ae6-8f74-5cfe1cbf26ca tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.219720 Sep 17 21:08:19.573749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 239/492] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:19 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:19.906966 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4705a298-17f4-43fb-b01a-4d88c8ff90dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.907571 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4705a298-17f4-43fb-b01a-4d88c8ff90dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:19.910525 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:19.911164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=12 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:19.915628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4705a298-17f4-43fb-b01a-4d88c8ff90dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:19.916105 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4705a298-17f4-43fb-b01a-4d88c8ff90dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:19.916532 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4705a298-17f4-43fb-b01a-4d88c8ff90dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:19.917247 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4705a298-17f4-43fb-b01a-4d88c8ff90dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:19.917699 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4705a298-17f4-43fb-b01a-4d88c8ff90dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:19.918116 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4705a298-17f4-43fb-b01a-4d88c8ff90dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:20.054379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4705a298-17f4-43fb-b01a-4d88c8ff90dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:20.062062 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4705a298-17f4-43fb-b01a-4d88c8ff90dd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1367 microversion: 2.1 time: 0.158896 Sep 17 21:08:20.062625 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 254/493] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:19 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:20.593870 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8356669e-81de-44ae-b5d5-52255745e63c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.594479 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8356669e-81de-44ae-b5d5-52255745e63c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:20.595027 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3753de01-3cca-45d2-8ed5-a93425a5056a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.595635 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3753de01-3cca-45d2-8ed5-a93425a5056a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:20.596308 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:20.602569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8356669e-81de-44ae-b5d5-52255745e63c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:20.603059 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3753de01-3cca-45d2-8ed5-a93425a5056a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:20.603188 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8356669e-81de-44ae-b5d5-52255745e63c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:20.603490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8356669e-81de-44ae-b5d5-52255745e63c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:20.603609 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3753de01-3cca-45d2-8ed5-a93425a5056a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:20.603968 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3753de01-3cca-45d2-8ed5-a93425a5056a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:20.604275 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8356669e-81de-44ae-b5d5-52255745e63c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:20.604707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3753de01-3cca-45d2-8ed5-a93425a5056a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:20.604810 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8356669e-81de-44ae-b5d5-52255745e63c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:20.605173 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3753de01-3cca-45d2-8ed5-a93425a5056a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:20.605521 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8356669e-81de-44ae-b5d5-52255745e63c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:20.605678 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3753de01-3cca-45d2-8ed5-a93425a5056a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:20.794152 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3753de01-3cca-45d2-8ed5-a93425a5056a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:20.798219 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8356669e-81de-44ae-b5d5-52255745e63c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:20.802348 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3753de01-3cca-45d2-8ed5-a93425a5056a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.211072 Sep 17 21:08:20.802992 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 255/494] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:20.806989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8356669e-81de-44ae-b5d5-52255745e63c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1723 microversion: 2.1 time: 0.217036 Sep 17 21:08:20.807552 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 240/495] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:21.085507 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9b8ad8ad-2161-4d1f-aff4-8445de1d0244 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:21.086140 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9b8ad8ad-2161-4d1f-aff4-8445de1d0244 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:21.092820 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b8ad8ad-2161-4d1f-aff4-8445de1d0244 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:21.093360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b8ad8ad-2161-4d1f-aff4-8445de1d0244 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:21.093790 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b8ad8ad-2161-4d1f-aff4-8445de1d0244 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:21.094515 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b8ad8ad-2161-4d1f-aff4-8445de1d0244 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:21.094975 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b8ad8ad-2161-4d1f-aff4-8445de1d0244 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:21.095421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b8ad8ad-2161-4d1f-aff4-8445de1d0244 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:21.236650 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9b8ad8ad-2161-4d1f-aff4-8445de1d0244 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:21.245430 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9b8ad8ad-2161-4d1f-aff4-8445de1d0244 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1556 microversion: 2.1 time: 0.164632 Sep 17 21:08:21.246130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 256/496] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:21 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:21.268363 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89a30f4e-a51b-4976-b737-36827403fb71 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:21.268884 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89a30f4e-a51b-4976-b737-36827403fb71 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:21.275514 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a30f4e-a51b-4976-b737-36827403fb71 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:21.275997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a30f4e-a51b-4976-b737-36827403fb71 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:21.276469 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a30f4e-a51b-4976-b737-36827403fb71 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:21.277187 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a30f4e-a51b-4976-b737-36827403fb71 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:21.277642 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a30f4e-a51b-4976-b737-36827403fb71 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:21.278061 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a30f4e-a51b-4976-b737-36827403fb71 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:21.355680 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89a30f4e-a51b-4976-b737-36827403fb71 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091338 Sep 17 21:08:21.356250 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 241/497] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 17 21:08:21 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:08:21.825424 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f6e08a53-97a5-4866-9e75-68f78a93394a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:21.826038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f6e08a53-97a5-4866-9e75-68f78a93394a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:21.830905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7ab17c3-f02c-4853-bff6-36b01f853498 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:21.831505 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f7ab17c3-f02c-4853-bff6-36b01f853498 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:21.833050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6e08a53-97a5-4866-9e75-68f78a93394a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:21.833674 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6e08a53-97a5-4866-9e75-68f78a93394a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:21.834178 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6e08a53-97a5-4866-9e75-68f78a93394a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:21.835163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6e08a53-97a5-4866-9e75-68f78a93394a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:21.835708 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6e08a53-97a5-4866-9e75-68f78a93394a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:21.836201 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6e08a53-97a5-4866-9e75-68f78a93394a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:21.838648 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7ab17c3-f02c-4853-bff6-36b01f853498 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:21.839164 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7ab17c3-f02c-4853-bff6-36b01f853498 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:21.839678 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7ab17c3-f02c-4853-bff6-36b01f853498 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:21.840436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7ab17c3-f02c-4853-bff6-36b01f853498 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:21.840947 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7ab17c3-f02c-4853-bff6-36b01f853498 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:21.841363 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7ab17c3-f02c-4853-bff6-36b01f853498 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:21.858709 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:22.134525 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7ab17c3-f02c-4853-bff6-36b01f853498 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:22.139510 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f6e08a53-97a5-4866-9e75-68f78a93394a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:22.142707 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7ab17c3-f02c-4853-bff6-36b01f853498 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1723 microversion: 2.1 time: 0.316293 Sep 17 21:08:22.143473 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 242/498] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:21 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:22.148387 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f6e08a53-97a5-4866-9e75-68f78a93394a tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.326995 Sep 17 21:08:22.149152 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 257/499] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:21 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:22.692191 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4e97d689-c209-4dff-95a5-409bf1bea105 req-e93baf03-d264-47b9-a153-d27dec354feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33fe9079-6aa4-43be-b5d0-8f5df95a890e", "tag": "8194fc95-84a0-4a89-b5d3-4e1533b9ce62"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:22.702451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4e97d689-c209-4dff-95a5-409bf1bea105 req-e93baf03-d264-47b9-a153-d27dec354feb service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:22.702928 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4e97d689-c209-4dff-95a5-409bf1bea105 req-e93baf03-d264-47b9-a153-d27dec354feb service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:22.703355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4e97d689-c209-4dff-95a5-409bf1bea105 req-e93baf03-d264-47b9-a153-d27dec354feb service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:22.714826 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4e97d689-c209-4dff-95a5-409bf1bea105 req-e93baf03-d264-47b9-a153-d27dec354feb service nova] Creating event network-changed:8194fc95-84a0-4a89-b5d3-4e1533b9ce62 for instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e on hv-cinder-82651 Sep 17 21:08:22.719887 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4e97d689-c209-4dff-95a5-409bf1bea105 req-e93baf03-d264-47b9-a153-d27dec354feb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031293 Sep 17 21:08:22.720476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 243/500] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:23.166587 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ef885c4a-6c59-4e80-b6df-70f62862f579 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:23.167284 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ef885c4a-6c59-4e80-b6df-70f62862f579 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:23.171512 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14272d89-88d9-4931-91a4-0bfb97572a35 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:23.172208 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14272d89-88d9-4931-91a4-0bfb97572a35 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:23.173608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef885c4a-6c59-4e80-b6df-70f62862f579 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:23.174100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef885c4a-6c59-4e80-b6df-70f62862f579 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:23.174534 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef885c4a-6c59-4e80-b6df-70f62862f579 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:23.176135 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef885c4a-6c59-4e80-b6df-70f62862f579 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:23.176135 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef885c4a-6c59-4e80-b6df-70f62862f579 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:23.176135 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef885c4a-6c59-4e80-b6df-70f62862f579 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:23.179373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14272d89-88d9-4931-91a4-0bfb97572a35 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:23.179852 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14272d89-88d9-4931-91a4-0bfb97572a35 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:23.180281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14272d89-88d9-4931-91a4-0bfb97572a35 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:23.180988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14272d89-88d9-4931-91a4-0bfb97572a35 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:23.181944 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14272d89-88d9-4931-91a4-0bfb97572a35 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:23.182598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14272d89-88d9-4931-91a4-0bfb97572a35 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:23.379546 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ef885c4a-6c59-4e80-b6df-70f62862f579 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:23.388623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-14272d89-88d9-4931-91a4-0bfb97572a35 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:23.393559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ef885c4a-6c59-4e80-b6df-70f62862f579 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1700 microversion: 2.1 time: 0.230930 Sep 17 21:08:23.404206 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 258/501] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:23 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1700 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:23.404307 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14272d89-88d9-4931-91a4-0bfb97572a35 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.229694 Sep 17 21:08:23.404307 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 244/502] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:23 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:23.417563 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc826089-4d3f-48be-bf3f-a3a3dba05b7a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:23.423570 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc826089-4d3f-48be-bf3f-a3a3dba05b7a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:23.424060 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc826089-4d3f-48be-bf3f-a3a3dba05b7a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:23.424498 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc826089-4d3f-48be-bf3f-a3a3dba05b7a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:23.487259 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc826089-4d3f-48be-bf3f-a3a3dba05b7a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Going to try to start instance {{(pid=120587) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 17 21:08:23.534064 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc826089-4d3f-48be-bf3f-a3a3dba05b7a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "POST /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/action" status: 202 len: 0 microversion: 2.1 time: 0.120028 Sep 17 21:08:23.534560 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 259/503] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:08:23 2022] POST /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:08:23.543431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b18f0c94-1877-4838-8f34-58be59e37882 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:23.544041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b18f0c94-1877-4838-8f34-58be59e37882 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:23.550245 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b18f0c94-1877-4838-8f34-58be59e37882 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:23.550735 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b18f0c94-1877-4838-8f34-58be59e37882 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:23.551170 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b18f0c94-1877-4838-8f34-58be59e37882 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:23.551872 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b18f0c94-1877-4838-8f34-58be59e37882 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:23.553105 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b18f0c94-1877-4838-8f34-58be59e37882 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:23.553552 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b18f0c94-1877-4838-8f34-58be59e37882 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:23.736761 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b18f0c94-1877-4838-8f34-58be59e37882 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:23.748173 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b18f0c94-1877-4838-8f34-58be59e37882 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1709 microversion: 2.1 time: 0.208503 Sep 17 21:08:23.748875 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 245/504] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:23 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1709 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:24.423481 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3dcd319c-01ba-4922-a94e-a9c27f5baa08 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:24.424171 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3dcd319c-01ba-4922-a94e-a9c27f5baa08 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:24.430339 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dcd319c-01ba-4922-a94e-a9c27f5baa08 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:24.430811 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dcd319c-01ba-4922-a94e-a9c27f5baa08 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:24.431244 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dcd319c-01ba-4922-a94e-a9c27f5baa08 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:24.431923 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dcd319c-01ba-4922-a94e-a9c27f5baa08 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:24.432369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dcd319c-01ba-4922-a94e-a9c27f5baa08 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:24.432815 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dcd319c-01ba-4922-a94e-a9c27f5baa08 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:24.563107 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3dcd319c-01ba-4922-a94e-a9c27f5baa08 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:24.571673 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3dcd319c-01ba-4922-a94e-a9c27f5baa08 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.152901 Sep 17 21:08:24.572245 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 260/505] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:24 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:24.772836 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70fd2ee0-5f5f-4347-918a-7621278316f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:24.773846 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70fd2ee0-5f5f-4347-918a-7621278316f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:24.781080 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70fd2ee0-5f5f-4347-918a-7621278316f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:24.781584 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70fd2ee0-5f5f-4347-918a-7621278316f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:24.782060 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70fd2ee0-5f5f-4347-918a-7621278316f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:24.782773 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70fd2ee0-5f5f-4347-918a-7621278316f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:24.783236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70fd2ee0-5f5f-4347-918a-7621278316f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:24.783671 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70fd2ee0-5f5f-4347-918a-7621278316f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:24.914536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-70fd2ee0-5f5f-4347-918a-7621278316f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:24.922730 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70fd2ee0-5f5f-4347-918a-7621278316f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1709 microversion: 2.1 time: 0.154619 Sep 17 21:08:24.923292 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 246/506] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:24 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:25.594655 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b50ae0c-33c2-460a-83d3-a0bc2822bec9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:25.595296 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1b50ae0c-33c2-460a-83d3-a0bc2822bec9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:25.597748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:25.603672 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b50ae0c-33c2-460a-83d3-a0bc2822bec9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.604159 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b50ae0c-33c2-460a-83d3-a0bc2822bec9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.604595 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b50ae0c-33c2-460a-83d3-a0bc2822bec9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.605319 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b50ae0c-33c2-460a-83d3-a0bc2822bec9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.605775 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b50ae0c-33c2-460a-83d3-a0bc2822bec9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.606201 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b50ae0c-33c2-460a-83d3-a0bc2822bec9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.735240 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1b50ae0c-33c2-460a-83d3-a0bc2822bec9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:25.742755 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b50ae0c-33c2-460a-83d3-a0bc2822bec9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.152095 Sep 17 21:08:25.743314 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 261/507] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:25 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:25.947433 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-167c0638-6728-4dec-a8e7-3f8c343205a9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:25.948040 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-167c0638-6728-4dec-a8e7-3f8c343205a9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:25.953924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-167c0638-6728-4dec-a8e7-3f8c343205a9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.954410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-167c0638-6728-4dec-a8e7-3f8c343205a9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.954846 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-167c0638-6728-4dec-a8e7-3f8c343205a9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.955533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-167c0638-6728-4dec-a8e7-3f8c343205a9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.955988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-167c0638-6728-4dec-a8e7-3f8c343205a9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.956412 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-167c0638-6728-4dec-a8e7-3f8c343205a9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:26.089475 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-167c0638-6728-4dec-a8e7-3f8c343205a9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:26.097688 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-167c0638-6728-4dec-a8e7-3f8c343205a9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1713 microversion: 2.1 time: 0.155351 Sep 17 21:08:26.098343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 247/508] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:25 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:26.765956 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34ee4cc2-44cd-491b-be4f-f451a86b5f25 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:26.766570 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34ee4cc2-44cd-491b-be4f-f451a86b5f25 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:26.773648 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34ee4cc2-44cd-491b-be4f-f451a86b5f25 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:26.774137 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34ee4cc2-44cd-491b-be4f-f451a86b5f25 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:26.774573 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34ee4cc2-44cd-491b-be4f-f451a86b5f25 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:26.775270 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34ee4cc2-44cd-491b-be4f-f451a86b5f25 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:26.775724 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34ee4cc2-44cd-491b-be4f-f451a86b5f25 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:26.776142 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34ee4cc2-44cd-491b-be4f-f451a86b5f25 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:26.902863 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-34ee4cc2-44cd-491b-be4f-f451a86b5f25 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:26.910389 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34ee4cc2-44cd-491b-be4f-f451a86b5f25 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.148343 Sep 17 21:08:26.910950 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 262/509] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:26 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:27.933908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba09b758-38d1-4177-acd0-a8480b66dd22 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:27.934525 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba09b758-38d1-4177-acd0-a8480b66dd22 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:27.937025 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:27.942123 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba09b758-38d1-4177-acd0-a8480b66dd22 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:27.942611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba09b758-38d1-4177-acd0-a8480b66dd22 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:27.943082 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba09b758-38d1-4177-acd0-a8480b66dd22 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:27.943778 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba09b758-38d1-4177-acd0-a8480b66dd22 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:27.944235 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba09b758-38d1-4177-acd0-a8480b66dd22 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:27.944936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba09b758-38d1-4177-acd0-a8480b66dd22 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:28.080163 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ba09b758-38d1-4177-acd0-a8480b66dd22 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:28.087913 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba09b758-38d1-4177-acd0-a8480b66dd22 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.157787 Sep 17 21:08:28.088470 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 248/510] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:27 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:28.183115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c605f291-f23f-4bcd-8393-d6905a4301af req-af393472-8c43-407b-a73a-72abd6b00474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3209ceff-722f-437e-9ece-3f9542c1daa7", "name": "network-vif-plugged", "status": "completed", "tag": "9ec72a7a-4fab-4ddb-9a94-b4581d132104"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:28.193541 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c605f291-f23f-4bcd-8393-d6905a4301af req-af393472-8c43-407b-a73a-72abd6b00474 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:28.194023 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c605f291-f23f-4bcd-8393-d6905a4301af req-af393472-8c43-407b-a73a-72abd6b00474 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:28.194712 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c605f291-f23f-4bcd-8393-d6905a4301af req-af393472-8c43-407b-a73a-72abd6b00474 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:28.206147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c605f291-f23f-4bcd-8393-d6905a4301af req-af393472-8c43-407b-a73a-72abd6b00474 service nova] Creating event network-vif-plugged:9ec72a7a-4fab-4ddb-9a94-b4581d132104 for instance 3209ceff-722f-437e-9ece-3f9542c1daa7 on hv-cinder-82651 Sep 17 21:08:28.211431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c605f291-f23f-4bcd-8393-d6905a4301af req-af393472-8c43-407b-a73a-72abd6b00474 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031926 Sep 17 21:08:28.212370 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 263/511] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:29.110956 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca5b3a2c-41b6-4d7a-9be8-9a31f27aa7ba tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:29.111595 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca5b3a2c-41b6-4d7a-9be8-9a31f27aa7ba tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:29.118644 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5b3a2c-41b6-4d7a-9be8-9a31f27aa7ba tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:29.119121 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5b3a2c-41b6-4d7a-9be8-9a31f27aa7ba tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:29.119552 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5b3a2c-41b6-4d7a-9be8-9a31f27aa7ba tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:29.120239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5b3a2c-41b6-4d7a-9be8-9a31f27aa7ba tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:29.120711 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5b3a2c-41b6-4d7a-9be8-9a31f27aa7ba tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:29.121138 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5b3a2c-41b6-4d7a-9be8-9a31f27aa7ba tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:29.247838 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca5b3a2c-41b6-4d7a-9be8-9a31f27aa7ba tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:29.256049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca5b3a2c-41b6-4d7a-9be8-9a31f27aa7ba tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.148938 Sep 17 21:08:29.256637 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 249/512] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:29 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:30.280235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e48d2b23-2c52-4428-9838-c3fcae6e0bb3 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:30.280956 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e48d2b23-2c52-4428-9838-c3fcae6e0bb3 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:30.287765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e48d2b23-2c52-4428-9838-c3fcae6e0bb3 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:30.288237 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e48d2b23-2c52-4428-9838-c3fcae6e0bb3 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:30.288686 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e48d2b23-2c52-4428-9838-c3fcae6e0bb3 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:30.289394 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e48d2b23-2c52-4428-9838-c3fcae6e0bb3 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:30.289850 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e48d2b23-2c52-4428-9838-c3fcae6e0bb3 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:30.290279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e48d2b23-2c52-4428-9838-c3fcae6e0bb3 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:30.427483 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e48d2b23-2c52-4428-9838-c3fcae6e0bb3 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:30.435856 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e48d2b23-2c52-4428-9838-c3fcae6e0bb3 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1260 microversion: 2.1 time: 0.160559 Sep 17 21:08:30.445010 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 264/513] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:30 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:31.459475 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9e5ddbd7-6782-43e5-bccd-f67d68809981 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:31.460094 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9e5ddbd7-6782-43e5-bccd-f67d68809981 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:31.466298 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e5ddbd7-6782-43e5-bccd-f67d68809981 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:31.466787 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e5ddbd7-6782-43e5-bccd-f67d68809981 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:31.467229 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e5ddbd7-6782-43e5-bccd-f67d68809981 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:31.467918 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e5ddbd7-6782-43e5-bccd-f67d68809981 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:31.468372 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e5ddbd7-6782-43e5-bccd-f67d68809981 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:31.468827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e5ddbd7-6782-43e5-bccd-f67d68809981 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:31.597758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9e5ddbd7-6782-43e5-bccd-f67d68809981 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:31.605952 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9e5ddbd7-6782-43e5-bccd-f67d68809981 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1444 microversion: 2.1 time: 0.150607 Sep 17 21:08:31.606513 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 250/514] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:31 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:31.628397 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2f618ada-d887-445b-add1-842e56846824 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:31.629035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2f618ada-d887-445b-add1-842e56846824 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:31.635461 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f618ada-d887-445b-add1-842e56846824 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:31.636087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f618ada-d887-445b-add1-842e56846824 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:31.636522 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f618ada-d887-445b-add1-842e56846824 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:31.637246 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f618ada-d887-445b-add1-842e56846824 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:31.637704 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f618ada-d887-445b-add1-842e56846824 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:31.638124 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f618ada-d887-445b-add1-842e56846824 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:31.771796 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2f618ada-d887-445b-add1-842e56846824 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:31.779501 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2f618ada-d887-445b-add1-842e56846824 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1444 microversion: 2.1 time: 0.154904 Sep 17 21:08:31.780061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 265/515] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:31 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:33.374590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c6dfda18-4daa-4117-abcf-810ade2e91bd req-0029e44c-adc4-43d2-ab26-1bfb4eafec5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3209ceff-722f-437e-9ece-3f9542c1daa7", "tag": "9ec72a7a-4fab-4ddb-9a94-b4581d132104"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:33.385283 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c6dfda18-4daa-4117-abcf-810ade2e91bd req-0029e44c-adc4-43d2-ab26-1bfb4eafec5d service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:33.385769 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c6dfda18-4daa-4117-abcf-810ade2e91bd req-0029e44c-adc4-43d2-ab26-1bfb4eafec5d service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:33.386203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c6dfda18-4daa-4117-abcf-810ade2e91bd req-0029e44c-adc4-43d2-ab26-1bfb4eafec5d service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:33.398255 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c6dfda18-4daa-4117-abcf-810ade2e91bd req-0029e44c-adc4-43d2-ab26-1bfb4eafec5d service nova] Creating event network-changed:9ec72a7a-4fab-4ddb-9a94-b4581d132104 for instance 3209ceff-722f-437e-9ece-3f9542c1daa7 on hv-cinder-82651 Sep 17 21:08:33.403178 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c6dfda18-4daa-4117-abcf-810ade2e91bd req-0029e44c-adc4-43d2-ab26-1bfb4eafec5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032219 Sep 17 21:08:33.403836 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 251/516] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:42.047418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5927056-fc47-41c6-ab5c-18fc1929035e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:42.047947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c5927056-fc47-41c6-ab5c-18fc1929035e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:42.050505 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=9 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:42.051192 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:42.056385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5927056-fc47-41c6-ab5c-18fc1929035e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:42.056905 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5927056-fc47-41c6-ab5c-18fc1929035e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:42.057340 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5927056-fc47-41c6-ab5c-18fc1929035e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:42.058072 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5927056-fc47-41c6-ab5c-18fc1929035e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:42.058642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5927056-fc47-41c6-ab5c-18fc1929035e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:42.059078 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5927056-fc47-41c6-ab5c-18fc1929035e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:42.084276 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c5927056-fc47-41c6-ab5c-18fc1929035e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/ips" status: 200 len: 152 microversion: 2.20 time: 0.040705 Sep 17 21:08:42.084777 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 266/517] 10.222.0.16 () {60 vars in 1289 bytes} [Sat Sep 17 21:08:42 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:08:44.173781 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=7 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:44.174441 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=74 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:44.179486 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a06c14d-ddd0-4491-93e4-70f82739ee8a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:44.180107 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a06c14d-ddd0-4491-93e4-70f82739ee8a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:44.187000 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a06c14d-ddd0-4491-93e4-70f82739ee8a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:44.187495 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a06c14d-ddd0-4491-93e4-70f82739ee8a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:44.187913 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a06c14d-ddd0-4491-93e4-70f82739ee8a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:44.188600 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a06c14d-ddd0-4491-93e4-70f82739ee8a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:44.189084 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a06c14d-ddd0-4491-93e4-70f82739ee8a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:44.189504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a06c14d-ddd0-4491-93e4-70f82739ee8a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:44.212821 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-1a06c14d-ddd0-4491-93e4-70f82739ee8a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lazy-loading 'flavor' on Instance uuid 785212fb-7493-49ce-b3f0-12b3742b3a88 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:08:44.438245 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a06c14d-ddd0-4491-93e4-70f82739ee8a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "POST /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/action" status: 202 len: 0 microversion: 2.20 time: 0.265659 Sep 17 21:08:44.438785 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 252/518] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 17 21:08:44 2022] POST /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:08:44.448302 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-987ba693-a4c1-4004-8609-7b1ffee93c43 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:44.448942 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-987ba693-a4c1-4004-8609-7b1ffee93c43 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:44.455422 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-987ba693-a4c1-4004-8609-7b1ffee93c43 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:44.455901 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-987ba693-a4c1-4004-8609-7b1ffee93c43 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:44.456336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-987ba693-a4c1-4004-8609-7b1ffee93c43 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:44.457312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-987ba693-a4c1-4004-8609-7b1ffee93c43 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:44.457840 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-987ba693-a4c1-4004-8609-7b1ffee93c43 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:44.458248 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-987ba693-a4c1-4004-8609-7b1ffee93c43 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:44.587127 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-987ba693-a4c1-4004-8609-7b1ffee93c43 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:44.595288 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-987ba693-a4c1-4004-8609-7b1ffee93c43 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:44.596752 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-987ba693-a4c1-4004-8609-7b1ffee93c43 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:44.597907 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-987ba693-a4c1-4004-8609-7b1ffee93c43 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.153812 Sep 17 21:08:44.598570 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 267/519] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:44 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:45.625634 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d954b50-cec5-4854-ba87-7129ab114007 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:45.626330 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d954b50-cec5-4854-ba87-7129ab114007 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:45.633808 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d954b50-cec5-4854-ba87-7129ab114007 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:45.634310 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d954b50-cec5-4854-ba87-7129ab114007 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:45.634744 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d954b50-cec5-4854-ba87-7129ab114007 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:45.635440 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d954b50-cec5-4854-ba87-7129ab114007 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:45.635892 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d954b50-cec5-4854-ba87-7129ab114007 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:45.636319 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d954b50-cec5-4854-ba87-7129ab114007 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:45.767733 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d954b50-cec5-4854-ba87-7129ab114007 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:45.776577 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d954b50-cec5-4854-ba87-7129ab114007 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:45.778037 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d954b50-cec5-4854-ba87-7129ab114007 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:45.779176 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d954b50-cec5-4854-ba87-7129ab114007 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.159001 Sep 17 21:08:45.779723 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 253/520] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:45 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:46.804308 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9939bc55-03c1-4ac5-abdc-f8eba099752a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:46.804943 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9939bc55-03c1-4ac5-abdc-f8eba099752a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:46.811305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9939bc55-03c1-4ac5-abdc-f8eba099752a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:46.811789 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9939bc55-03c1-4ac5-abdc-f8eba099752a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:46.812222 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9939bc55-03c1-4ac5-abdc-f8eba099752a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:46.812945 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9939bc55-03c1-4ac5-abdc-f8eba099752a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:46.813393 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9939bc55-03c1-4ac5-abdc-f8eba099752a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:46.813814 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9939bc55-03c1-4ac5-abdc-f8eba099752a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:46.940159 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9939bc55-03c1-4ac5-abdc-f8eba099752a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:46.948813 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9939bc55-03c1-4ac5-abdc-f8eba099752a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:46.950258 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9939bc55-03c1-4ac5-abdc-f8eba099752a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:46.951415 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9939bc55-03c1-4ac5-abdc-f8eba099752a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.151106 Sep 17 21:08:46.951967 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 268/521] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:46 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:47.977109 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b798511-d00a-4bdd-a7d9-ca4c32c0ea6f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:47.977719 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0b798511-d00a-4bdd-a7d9-ca4c32c0ea6f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:47.984104 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b798511-d00a-4bdd-a7d9-ca4c32c0ea6f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:47.984580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b798511-d00a-4bdd-a7d9-ca4c32c0ea6f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:47.985043 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b798511-d00a-4bdd-a7d9-ca4c32c0ea6f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:47.985731 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b798511-d00a-4bdd-a7d9-ca4c32c0ea6f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:47.986182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b798511-d00a-4bdd-a7d9-ca4c32c0ea6f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:47.986604 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b798511-d00a-4bdd-a7d9-ca4c32c0ea6f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:48.117848 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0b798511-d00a-4bdd-a7d9-ca4c32c0ea6f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:48.125849 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0b798511-d00a-4bdd-a7d9-ca4c32c0ea6f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:48.127291 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0b798511-d00a-4bdd-a7d9-ca4c32c0ea6f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:48.128545 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0b798511-d00a-4bdd-a7d9-ca4c32c0ea6f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.155551 Sep 17 21:08:48.129138 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 254/522] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:47 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:49.155036 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-703e021a-a3dc-4f95-9b3c-518e7d4999cb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:49.155660 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-703e021a-a3dc-4f95-9b3c-518e7d4999cb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:49.162573 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-703e021a-a3dc-4f95-9b3c-518e7d4999cb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.163050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-703e021a-a3dc-4f95-9b3c-518e7d4999cb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.163483 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-703e021a-a3dc-4f95-9b3c-518e7d4999cb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.164164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-703e021a-a3dc-4f95-9b3c-518e7d4999cb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.164611 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-703e021a-a3dc-4f95-9b3c-518e7d4999cb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.165055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-703e021a-a3dc-4f95-9b3c-518e7d4999cb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.291108 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-703e021a-a3dc-4f95-9b3c-518e7d4999cb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:49.299032 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-703e021a-a3dc-4f95-9b3c-518e7d4999cb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:49.300457 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-703e021a-a3dc-4f95-9b3c-518e7d4999cb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:49.301663 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-703e021a-a3dc-4f95-9b3c-518e7d4999cb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.150614 Sep 17 21:08:49.302502 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 269/523] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:49 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:50.327316 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ecd702da-2a90-4443-9d5b-61df11cb7b12 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:50.327929 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ecd702da-2a90-4443-9d5b-61df11cb7b12 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:50.334657 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecd702da-2a90-4443-9d5b-61df11cb7b12 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:50.335144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecd702da-2a90-4443-9d5b-61df11cb7b12 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:50.335583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecd702da-2a90-4443-9d5b-61df11cb7b12 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:50.336301 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecd702da-2a90-4443-9d5b-61df11cb7b12 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:50.336792 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecd702da-2a90-4443-9d5b-61df11cb7b12 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:50.337221 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecd702da-2a90-4443-9d5b-61df11cb7b12 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:50.482122 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ecd702da-2a90-4443-9d5b-61df11cb7b12 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:50.490690 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ecd702da-2a90-4443-9d5b-61df11cb7b12 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:50.492119 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ecd702da-2a90-4443-9d5b-61df11cb7b12 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:50.493396 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ecd702da-2a90-4443-9d5b-61df11cb7b12 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.169999 Sep 17 21:08:50.493943 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 255/524] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:50 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:51.518557 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f380ffb-818c-4190-85ae-b39bfb8b6e44 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:51.519090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f380ffb-818c-4190-85ae-b39bfb8b6e44 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:51.525569 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f380ffb-818c-4190-85ae-b39bfb8b6e44 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:51.526050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f380ffb-818c-4190-85ae-b39bfb8b6e44 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:51.526485 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f380ffb-818c-4190-85ae-b39bfb8b6e44 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:51.527170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f380ffb-818c-4190-85ae-b39bfb8b6e44 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:51.527622 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f380ffb-818c-4190-85ae-b39bfb8b6e44 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:51.528043 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f380ffb-818c-4190-85ae-b39bfb8b6e44 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:51.657879 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f380ffb-818c-4190-85ae-b39bfb8b6e44 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:51.666792 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f380ffb-818c-4190-85ae-b39bfb8b6e44 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:51.669877 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f380ffb-818c-4190-85ae-b39bfb8b6e44 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:51.671032 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f380ffb-818c-4190-85ae-b39bfb8b6e44 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.156434 Sep 17 21:08:51.671589 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 270/525] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:51 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:52.697690 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30a41cb7-9eea-49e3-b319-b568bc0721fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:52.698297 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30a41cb7-9eea-49e3-b319-b568bc0721fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:52.704898 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30a41cb7-9eea-49e3-b319-b568bc0721fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:52.705382 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30a41cb7-9eea-49e3-b319-b568bc0721fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:52.705874 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30a41cb7-9eea-49e3-b319-b568bc0721fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:52.706561 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30a41cb7-9eea-49e3-b319-b568bc0721fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:52.707009 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30a41cb7-9eea-49e3-b319-b568bc0721fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:52.707429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30a41cb7-9eea-49e3-b319-b568bc0721fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:52.832369 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-30a41cb7-9eea-49e3-b319-b568bc0721fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:52.840500 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-30a41cb7-9eea-49e3-b319-b568bc0721fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:52.841964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-30a41cb7-9eea-49e3-b319-b568bc0721fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:52.843102 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30a41cb7-9eea-49e3-b319-b568bc0721fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.149588 Sep 17 21:08:52.843651 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 256/526] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:52 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:53.868445 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-58133aca-06e7-4a52-abab-ac515487165d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:53.869082 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-58133aca-06e7-4a52-abab-ac515487165d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:53.875504 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58133aca-06e7-4a52-abab-ac515487165d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:53.875981 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58133aca-06e7-4a52-abab-ac515487165d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:53.876409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58133aca-06e7-4a52-abab-ac515487165d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:53.877122 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58133aca-06e7-4a52-abab-ac515487165d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:53.877570 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58133aca-06e7-4a52-abab-ac515487165d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:53.877985 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58133aca-06e7-4a52-abab-ac515487165d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:54.009368 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-58133aca-06e7-4a52-abab-ac515487165d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:54.017442 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-58133aca-06e7-4a52-abab-ac515487165d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:54.018889 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-58133aca-06e7-4a52-abab-ac515487165d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:54.020038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-58133aca-06e7-4a52-abab-ac515487165d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.155505 Sep 17 21:08:54.021426 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 271/527] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:53 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:55.046156 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0651af6b-f4f8-4eac-bd88-523fd288cae0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:55.046767 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0651af6b-f4f8-4eac-bd88-523fd288cae0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:55.053354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0651af6b-f4f8-4eac-bd88-523fd288cae0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:55.053836 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0651af6b-f4f8-4eac-bd88-523fd288cae0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:55.054288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0651af6b-f4f8-4eac-bd88-523fd288cae0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:55.054980 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0651af6b-f4f8-4eac-bd88-523fd288cae0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:55.055429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0651af6b-f4f8-4eac-bd88-523fd288cae0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:55.055875 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0651af6b-f4f8-4eac-bd88-523fd288cae0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:55.185100 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0651af6b-f4f8-4eac-bd88-523fd288cae0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:55.193058 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0651af6b-f4f8-4eac-bd88-523fd288cae0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:55.194760 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0651af6b-f4f8-4eac-bd88-523fd288cae0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:55.195901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0651af6b-f4f8-4eac-bd88-523fd288cae0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.153639 Sep 17 21:08:55.196451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 257/528] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:55 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:56.221599 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-acab8299-275e-4136-ad4b-83da44c0348a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:56.222226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-acab8299-275e-4136-ad4b-83da44c0348a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:56.228912 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acab8299-275e-4136-ad4b-83da44c0348a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:56.229392 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acab8299-275e-4136-ad4b-83da44c0348a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:56.229824 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acab8299-275e-4136-ad4b-83da44c0348a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:56.230511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acab8299-275e-4136-ad4b-83da44c0348a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:56.230965 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acab8299-275e-4136-ad4b-83da44c0348a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:56.231383 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acab8299-275e-4136-ad4b-83da44c0348a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:56.358048 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-acab8299-275e-4136-ad4b-83da44c0348a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:56.366567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-acab8299-275e-4136-ad4b-83da44c0348a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:56.367992 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-acab8299-275e-4136-ad4b-83da44c0348a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:56.369168 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-acab8299-275e-4136-ad4b-83da44c0348a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.151458 Sep 17 21:08:56.369711 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 272/529] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:56 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:57.394491 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5e59934-0185-4687-b342-09d8fb522430 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:57.395141 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a5e59934-0185-4687-b342-09d8fb522430 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:57.401701 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5e59934-0185-4687-b342-09d8fb522430 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:57.402184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5e59934-0185-4687-b342-09d8fb522430 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:57.402618 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5e59934-0185-4687-b342-09d8fb522430 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:57.403305 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5e59934-0185-4687-b342-09d8fb522430 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:57.403758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5e59934-0185-4687-b342-09d8fb522430 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:57.404180 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5e59934-0185-4687-b342-09d8fb522430 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:57.534260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5e59934-0185-4687-b342-09d8fb522430 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:57.543041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5e59934-0185-4687-b342-09d8fb522430 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:57.544475 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5e59934-0185-4687-b342-09d8fb522430 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:57.545647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a5e59934-0185-4687-b342-09d8fb522430 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.155229 Sep 17 21:08:57.546190 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 258/530] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:57 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:58.571770 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a524cb1b-8edb-4ff9-8507-bac30fa0c794 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:58.572369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a524cb1b-8edb-4ff9-8507-bac30fa0c794 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:58.578332 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a524cb1b-8edb-4ff9-8507-bac30fa0c794 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:58.578816 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a524cb1b-8edb-4ff9-8507-bac30fa0c794 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:58.579233 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a524cb1b-8edb-4ff9-8507-bac30fa0c794 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:58.579919 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a524cb1b-8edb-4ff9-8507-bac30fa0c794 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:58.580367 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a524cb1b-8edb-4ff9-8507-bac30fa0c794 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:58.580809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a524cb1b-8edb-4ff9-8507-bac30fa0c794 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:58.707040 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a524cb1b-8edb-4ff9-8507-bac30fa0c794 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:58.715470 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a524cb1b-8edb-4ff9-8507-bac30fa0c794 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:58.716928 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a524cb1b-8edb-4ff9-8507-bac30fa0c794 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:58.718085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a524cb1b-8edb-4ff9-8507-bac30fa0c794 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.150818 Sep 17 21:08:58.718887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 273/531] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:58 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:59.745809 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7fc1c5d-d011-48ee-8606-4105f3368787 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:59.746514 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e7fc1c5d-d011-48ee-8606-4105f3368787 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:59.752861 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7fc1c5d-d011-48ee-8606-4105f3368787 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:59.753340 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7fc1c5d-d011-48ee-8606-4105f3368787 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:59.753772 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7fc1c5d-d011-48ee-8606-4105f3368787 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:59.754476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7fc1c5d-d011-48ee-8606-4105f3368787 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:59.754923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7fc1c5d-d011-48ee-8606-4105f3368787 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:59.755341 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7fc1c5d-d011-48ee-8606-4105f3368787 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:59.883330 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e7fc1c5d-d011-48ee-8606-4105f3368787 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:59.891519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e7fc1c5d-d011-48ee-8606-4105f3368787 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:59.893007 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e7fc1c5d-d011-48ee-8606-4105f3368787 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:59.894169 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e7fc1c5d-d011-48ee-8606-4105f3368787 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.152224 Sep 17 21:08:59.894726 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 259/532] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:59 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:00.919828 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c7abf5a-385c-49dc-9c2a-09bded4fcbae tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:00.920437 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c7abf5a-385c-49dc-9c2a-09bded4fcbae tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:00.927467 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c7abf5a-385c-49dc-9c2a-09bded4fcbae tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:00.927949 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c7abf5a-385c-49dc-9c2a-09bded4fcbae tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:00.928389 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c7abf5a-385c-49dc-9c2a-09bded4fcbae tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:00.929123 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c7abf5a-385c-49dc-9c2a-09bded4fcbae tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:00.929584 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c7abf5a-385c-49dc-9c2a-09bded4fcbae tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:00.930011 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c7abf5a-385c-49dc-9c2a-09bded4fcbae tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:01.058170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c7abf5a-385c-49dc-9c2a-09bded4fcbae tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:01.066152 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c7abf5a-385c-49dc-9c2a-09bded4fcbae tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:01.068226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c7abf5a-385c-49dc-9c2a-09bded4fcbae tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:01.069679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c7abf5a-385c-49dc-9c2a-09bded4fcbae tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.153760 Sep 17 21:09:01.070240 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 274/533] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:00 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:02.094804 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ecf6359-7984-4b12-910c-19ba243573f5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:02.095373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2ecf6359-7984-4b12-910c-19ba243573f5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:02.101318 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ecf6359-7984-4b12-910c-19ba243573f5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:02.101798 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ecf6359-7984-4b12-910c-19ba243573f5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:02.102225 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ecf6359-7984-4b12-910c-19ba243573f5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:02.102905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ecf6359-7984-4b12-910c-19ba243573f5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:02.103353 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ecf6359-7984-4b12-910c-19ba243573f5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:02.103767 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ecf6359-7984-4b12-910c-19ba243573f5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:02.238130 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ecf6359-7984-4b12-910c-19ba243573f5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:02.246369 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ecf6359-7984-4b12-910c-19ba243573f5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:02.247803 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ecf6359-7984-4b12-910c-19ba243573f5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:02.248984 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ecf6359-7984-4b12-910c-19ba243573f5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1744 microversion: 2.20 time: 0.158259 Sep 17 21:09:02.249537 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 260/534] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:02 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:03.274291 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-888c23a5-63cb-415b-b128-8404b2c2d742 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:03.274911 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-888c23a5-63cb-415b-b128-8404b2c2d742 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:03.281206 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-888c23a5-63cb-415b-b128-8404b2c2d742 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:03.281679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-888c23a5-63cb-415b-b128-8404b2c2d742 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:03.282105 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-888c23a5-63cb-415b-b128-8404b2c2d742 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:03.282780 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-888c23a5-63cb-415b-b128-8404b2c2d742 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:03.283226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-888c23a5-63cb-415b-b128-8404b2c2d742 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:03.283640 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-888c23a5-63cb-415b-b128-8404b2c2d742 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:03.415703 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-888c23a5-63cb-415b-b128-8404b2c2d742 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:03.423766 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-888c23a5-63cb-415b-b128-8404b2c2d742 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:03.425242 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-888c23a5-63cb-415b-b128-8404b2c2d742 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:03.426429 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-888c23a5-63cb-415b-b128-8404b2c2d742 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1744 microversion: 2.20 time: 0.156224 Sep 17 21:09:03.427492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 275/535] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:03 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:04.364382 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5aa23a46-9830-49a6-9a58-6abac1853d42 req-376825fd-c7c7-4dae-8349-4d878c474a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785212fb-7493-49ce-b3f0-12b3742b3a88", "name": "network-vif-plugged", "status": "completed", "tag": "3a9a1b04-a0c4-4a66-a693-a268f50c530b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:04.374917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5aa23a46-9830-49a6-9a58-6abac1853d42 req-376825fd-c7c7-4dae-8349-4d878c474a25 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:04.375467 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5aa23a46-9830-49a6-9a58-6abac1853d42 req-376825fd-c7c7-4dae-8349-4d878c474a25 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:04.375864 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5aa23a46-9830-49a6-9a58-6abac1853d42 req-376825fd-c7c7-4dae-8349-4d878c474a25 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:04.391958 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5aa23a46-9830-49a6-9a58-6abac1853d42 req-376825fd-c7c7-4dae-8349-4d878c474a25 service nova] Creating event network-vif-plugged:3a9a1b04-a0c4-4a66-a693-a268f50c530b for instance 785212fb-7493-49ce-b3f0-12b3742b3a88 on hv-cinder-82651 Sep 17 21:09:04.396661 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1058e5c4-d223-4448-a8a2-9cf34f98724b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66c9fa72-73b3-4c90-9fe9-1ba51ca9163c"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:04.398118 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5aa23a46-9830-49a6-9a58-6abac1853d42 req-376825fd-c7c7-4dae-8349-4d878c474a25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037414 Sep 17 21:09:04.399426 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 261/536] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:04.400920 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1058e5c4-d223-4448-a8a2-9cf34f98724b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:04.409053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1058e5c4-d223-4448-a8a2-9cf34f98724b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:04.409584 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1058e5c4-d223-4448-a8a2-9cf34f98724b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:04.410255 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1058e5c4-d223-4448-a8a2-9cf34f98724b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:04.411093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1058e5c4-d223-4448-a8a2-9cf34f98724b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:04.411485 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1058e5c4-d223-4448-a8a2-9cf34f98724b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:04.411978 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1058e5c4-d223-4448-a8a2-9cf34f98724b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:04.454868 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-109d3537-aa5d-4c82-99b3-e865c27a5105 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:04.455567 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-109d3537-aa5d-4c82-99b3-e865c27a5105 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:04.462429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-109d3537-aa5d-4c82-99b3-e865c27a5105 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:04.462921 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-109d3537-aa5d-4c82-99b3-e865c27a5105 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:04.463377 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-109d3537-aa5d-4c82-99b3-e865c27a5105 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:04.464061 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-109d3537-aa5d-4c82-99b3-e865c27a5105 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:04.464521 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-109d3537-aa5d-4c82-99b3-e865c27a5105 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:04.464976 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-109d3537-aa5d-4c82-99b3-e865c27a5105 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:04.606141 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-109d3537-aa5d-4c82-99b3-e865c27a5105 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:04.618324 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-109d3537-aa5d-4c82-99b3-e865c27a5105 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:04.619770 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-109d3537-aa5d-4c82-99b3-e865c27a5105 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:04.620973 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-109d3537-aa5d-4c82-99b3-e865c27a5105 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1744 microversion: 2.20 time: 0.170274 Sep 17 21:09:04.621532 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 262/537] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:04 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:04.682050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1058e5c4-d223-4448-a8a2-9cf34f98724b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "POST /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295831 Sep 17 21:09:04.682721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 276/538] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:09:04 2022] POST /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:05.656770 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3d7af82f-d459-4306-a154-edd6e87ac9ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:05.657320 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3d7af82f-d459-4306-a154-edd6e87ac9ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:05.663720 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d7af82f-d459-4306-a154-edd6e87ac9ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:05.664192 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d7af82f-d459-4306-a154-edd6e87ac9ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:05.664637 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d7af82f-d459-4306-a154-edd6e87ac9ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:05.665328 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d7af82f-d459-4306-a154-edd6e87ac9ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:05.665783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d7af82f-d459-4306-a154-edd6e87ac9ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:05.666197 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d7af82f-d459-4306-a154-edd6e87ac9ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:06.045834 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d7af82f-d459-4306-a154-edd6e87ac9ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:06.054566 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d7af82f-d459-4306-a154-edd6e87ac9ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:06.056072 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d7af82f-d459-4306-a154-edd6e87ac9ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:06.057266 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3d7af82f-d459-4306-a154-edd6e87ac9ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1744 microversion: 2.20 time: 0.404476 Sep 17 21:09:06.057849 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 263/539] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:05 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1744 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:07.084395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f43b55b8-51e7-4bf1-82b4-09178319928d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:07.085052 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f43b55b8-51e7-4bf1-82b4-09178319928d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:07.091182 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f43b55b8-51e7-4bf1-82b4-09178319928d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:07.091659 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f43b55b8-51e7-4bf1-82b4-09178319928d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:07.092088 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f43b55b8-51e7-4bf1-82b4-09178319928d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:07.092809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f43b55b8-51e7-4bf1-82b4-09178319928d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:07.093257 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f43b55b8-51e7-4bf1-82b4-09178319928d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:07.093708 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f43b55b8-51e7-4bf1-82b4-09178319928d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:07.221020 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f43b55b8-51e7-4bf1-82b4-09178319928d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:07.230414 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f43b55b8-51e7-4bf1-82b4-09178319928d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:07.231873 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f43b55b8-51e7-4bf1-82b4-09178319928d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:07.233072 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f43b55b8-51e7-4bf1-82b4-09178319928d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1744 microversion: 2.20 time: 0.153574 Sep 17 21:09:07.233625 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 277/540] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:07 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:08.258482 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-970d11e4-665e-45ff-b702-7ce46f48c088 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:08.259198 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-970d11e4-665e-45ff-b702-7ce46f48c088 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:08.265744 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970d11e4-665e-45ff-b702-7ce46f48c088 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:08.266293 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970d11e4-665e-45ff-b702-7ce46f48c088 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:08.266727 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970d11e4-665e-45ff-b702-7ce46f48c088 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:08.267410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970d11e4-665e-45ff-b702-7ce46f48c088 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:08.267861 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970d11e4-665e-45ff-b702-7ce46f48c088 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:08.268278 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970d11e4-665e-45ff-b702-7ce46f48c088 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:08.405996 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-970d11e4-665e-45ff-b702-7ce46f48c088 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:08.418781 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-970d11e4-665e-45ff-b702-7ce46f48c088 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:08.420213 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-970d11e4-665e-45ff-b702-7ce46f48c088 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:08.421708 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-970d11e4-665e-45ff-b702-7ce46f48c088 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1739 microversion: 2.20 time: 0.167634 Sep 17 21:09:08.422258 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 264/541] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:08 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:09.453181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1eeeffeb-47d0-4725-a6ba-0800e371dd06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:09.453845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1eeeffeb-47d0-4725-a6ba-0800e371dd06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:09.460441 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1eeeffeb-47d0-4725-a6ba-0800e371dd06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:09.461032 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1eeeffeb-47d0-4725-a6ba-0800e371dd06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:09.461530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1eeeffeb-47d0-4725-a6ba-0800e371dd06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:09.462508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1eeeffeb-47d0-4725-a6ba-0800e371dd06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:09.462969 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1eeeffeb-47d0-4725-a6ba-0800e371dd06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:09.463397 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1eeeffeb-47d0-4725-a6ba-0800e371dd06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:09.649030 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1eeeffeb-47d0-4725-a6ba-0800e371dd06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:09.658832 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1eeeffeb-47d0-4725-a6ba-0800e371dd06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:09.660514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1eeeffeb-47d0-4725-a6ba-0800e371dd06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:09.661741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1eeeffeb-47d0-4725-a6ba-0800e371dd06 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1739 microversion: 2.20 time: 0.212648 Sep 17 21:09:09.662284 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 278/542] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:09 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:10.687196 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09123a53-3599-4d79-9b18-f5916d65d1ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:10.687937 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09123a53-3599-4d79-9b18-f5916d65d1ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:10.695379 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09123a53-3599-4d79-9b18-f5916d65d1ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:10.696098 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09123a53-3599-4d79-9b18-f5916d65d1ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:10.696538 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09123a53-3599-4d79-9b18-f5916d65d1ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:10.697265 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09123a53-3599-4d79-9b18-f5916d65d1ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:10.698190 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09123a53-3599-4d79-9b18-f5916d65d1ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:10.698786 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09123a53-3599-4d79-9b18-f5916d65d1ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:10.845245 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-09123a53-3599-4d79-9b18-f5916d65d1ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:10.854656 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-09123a53-3599-4d79-9b18-f5916d65d1ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:10.856095 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-09123a53-3599-4d79-9b18-f5916d65d1ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:10.857286 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09123a53-3599-4d79-9b18-f5916d65d1ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1739 microversion: 2.20 time: 0.174224 Sep 17 21:09:10.858264 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 265/543] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:10 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:11.886357 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c6329f02-7efd-4dab-86ec-83f13131ce62 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:11.887016 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c6329f02-7efd-4dab-86ec-83f13131ce62 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:11.893862 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6329f02-7efd-4dab-86ec-83f13131ce62 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:11.894347 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6329f02-7efd-4dab-86ec-83f13131ce62 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:11.894776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6329f02-7efd-4dab-86ec-83f13131ce62 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:11.895482 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6329f02-7efd-4dab-86ec-83f13131ce62 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:11.895930 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6329f02-7efd-4dab-86ec-83f13131ce62 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:11.896458 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6329f02-7efd-4dab-86ec-83f13131ce62 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:12.036579 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6329f02-7efd-4dab-86ec-83f13131ce62 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:12.046257 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6329f02-7efd-4dab-86ec-83f13131ce62 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:12.047951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6329f02-7efd-4dab-86ec-83f13131ce62 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:12.049327 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c6329f02-7efd-4dab-86ec-83f13131ce62 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1739 microversion: 2.20 time: 0.166900 Sep 17 21:09:12.050068 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 279/544] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:11 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:12.314291 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9103d382-8cd3-401f-a3bf-cce1aa320d06 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:12.318629 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9103d382-8cd3-401f-a3bf-cce1aa320d06 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:12.328027 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9103d382-8cd3-401f-a3bf-cce1aa320d06 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:12.328845 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9103d382-8cd3-401f-a3bf-cce1aa320d06 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:12.329433 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9103d382-8cd3-401f-a3bf-cce1aa320d06 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:12.330301 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9103d382-8cd3-401f-a3bf-cce1aa320d06 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:12.330905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9103d382-8cd3-401f-a3bf-cce1aa320d06 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:12.331779 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9103d382-8cd3-401f-a3bf-cce1aa320d06 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:12.362639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-9103d382-8cd3-401f-a3bf-cce1aa320d06 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lazy-loading 'flavor' on Instance uuid 643a631e-9207-4669-a0bb-623a4a8ebf94 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:09:12.380253 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:12.519871 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9103d382-8cd3-401f-a3bf-cce1aa320d06 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "POST /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/action" status: 200 len: 32 microversion: 2.1 time: 0.211107 Sep 17 21:09:12.521144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 266/545] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:09:12 2022] POST /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/action => generated 32 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:09:12.536067 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-82fe8972-e82b-4355-a1a9-b2c74f966e41 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:12.536709 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-82fe8972-e82b-4355-a1a9-b2c74f966e41 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:12.548282 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=29 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:12.550169 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82fe8972-e82b-4355-a1a9-b2c74f966e41 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:12.550632 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82fe8972-e82b-4355-a1a9-b2c74f966e41 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:12.551074 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82fe8972-e82b-4355-a1a9-b2c74f966e41 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:12.551772 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82fe8972-e82b-4355-a1a9-b2c74f966e41 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:12.555906 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82fe8972-e82b-4355-a1a9-b2c74f966e41 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:12.556577 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82fe8972-e82b-4355-a1a9-b2c74f966e41 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:12.560517 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:12.872111 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-82fe8972-e82b-4355-a1a9-b2c74f966e41 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:12.883986 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-82fe8972-e82b-4355-a1a9-b2c74f966e41 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.356130 Sep 17 21:09:12.885252 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 280/546] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:12 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:13.077924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b963c6e-345e-4fa2-b73b-11c91c73dabc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:13.079027 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b963c6e-345e-4fa2-b73b-11c91c73dabc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:13.089964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b963c6e-345e-4fa2-b73b-11c91c73dabc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:13.090810 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b963c6e-345e-4fa2-b73b-11c91c73dabc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:13.091470 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b963c6e-345e-4fa2-b73b-11c91c73dabc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:13.092414 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b963c6e-345e-4fa2-b73b-11c91c73dabc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:13.093120 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b963c6e-345e-4fa2-b73b-11c91c73dabc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:13.093757 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b963c6e-345e-4fa2-b73b-11c91c73dabc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:13.344641 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b963c6e-345e-4fa2-b73b-11c91c73dabc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:13.356309 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b963c6e-345e-4fa2-b73b-11c91c73dabc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:13.357860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b963c6e-345e-4fa2-b73b-11c91c73dabc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:13.359367 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b963c6e-345e-4fa2-b73b-11c91c73dabc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1739 microversion: 2.20 time: 0.287238 Sep 17 21:09:13.360353 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 267/547] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:13 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:13.914589 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34a8f243-a073-4f00-b744-6f5fa322e703 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:13.915200 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34a8f243-a073-4f00-b744-6f5fa322e703 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:13.921633 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a8f243-a073-4f00-b744-6f5fa322e703 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:13.922088 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a8f243-a073-4f00-b744-6f5fa322e703 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:13.922529 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a8f243-a073-4f00-b744-6f5fa322e703 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:13.923229 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a8f243-a073-4f00-b744-6f5fa322e703 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:13.923685 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a8f243-a073-4f00-b744-6f5fa322e703 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:13.924111 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a8f243-a073-4f00-b744-6f5fa322e703 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:14.061007 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-34a8f243-a073-4f00-b744-6f5fa322e703 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:14.070453 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34a8f243-a073-4f00-b744-6f5fa322e703 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.160540 Sep 17 21:09:14.071009 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 281/548] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:13 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:14.386456 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-af445e68-441c-4e35-a0e3-0d032f150c4c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:14.391683 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-af445e68-441c-4e35-a0e3-0d032f150c4c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:14.395154 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=33 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:14.402611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af445e68-441c-4e35-a0e3-0d032f150c4c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:14.403353 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af445e68-441c-4e35-a0e3-0d032f150c4c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:14.403978 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af445e68-441c-4e35-a0e3-0d032f150c4c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:14.411196 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af445e68-441c-4e35-a0e3-0d032f150c4c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:14.412509 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af445e68-441c-4e35-a0e3-0d032f150c4c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:14.413592 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af445e68-441c-4e35-a0e3-0d032f150c4c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:14.615797 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-af445e68-441c-4e35-a0e3-0d032f150c4c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:14.624500 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-af445e68-441c-4e35-a0e3-0d032f150c4c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:14.626081 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-af445e68-441c-4e35-a0e3-0d032f150c4c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:14.627507 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-af445e68-441c-4e35-a0e3-0d032f150c4c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1739 microversion: 2.20 time: 0.244956 Sep 17 21:09:14.633422 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 268/549] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:14 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:15.094553 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cb0f1013-e979-45ac-bdd2-514f519bbc0a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:15.095156 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cb0f1013-e979-45ac-bdd2-514f519bbc0a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:15.101995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb0f1013-e979-45ac-bdd2-514f519bbc0a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:15.102474 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb0f1013-e979-45ac-bdd2-514f519bbc0a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:15.102915 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb0f1013-e979-45ac-bdd2-514f519bbc0a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:15.103790 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb0f1013-e979-45ac-bdd2-514f519bbc0a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:15.104055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb0f1013-e979-45ac-bdd2-514f519bbc0a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:15.104485 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb0f1013-e979-45ac-bdd2-514f519bbc0a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:15.254953 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cb0f1013-e979-45ac-bdd2-514f519bbc0a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:15.264867 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cb0f1013-e979-45ac-bdd2-514f519bbc0a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.174227 Sep 17 21:09:15.265785 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 282/550] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:15 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:15.654539 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f4ec0ded-4382-4780-98fc-5fdc185d3ece tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:15.655244 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f4ec0ded-4382-4780-98fc-5fdc185d3ece tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:15.663038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4ec0ded-4382-4780-98fc-5fdc185d3ece tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:15.663630 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4ec0ded-4382-4780-98fc-5fdc185d3ece tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:15.665638 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4ec0ded-4382-4780-98fc-5fdc185d3ece tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:15.666568 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4ec0ded-4382-4780-98fc-5fdc185d3ece tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:15.667563 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4ec0ded-4382-4780-98fc-5fdc185d3ece tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:15.668176 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4ec0ded-4382-4780-98fc-5fdc185d3ece tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:15.821589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f4ec0ded-4382-4780-98fc-5fdc185d3ece tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:15.831472 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f4ec0ded-4382-4780-98fc-5fdc185d3ece tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:15.834487 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f4ec0ded-4382-4780-98fc-5fdc185d3ece tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:15.836503 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f4ec0ded-4382-4780-98fc-5fdc185d3ece tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1739 microversion: 2.20 time: 0.186273 Sep 17 21:09:15.837079 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 269/551] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:15 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:16.289584 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f488e2b3-3d78-41c1-acdf-36ae5f49ebe0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:16.290477 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f488e2b3-3d78-41c1-acdf-36ae5f49ebe0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:16.296878 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f488e2b3-3d78-41c1-acdf-36ae5f49ebe0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:16.297469 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f488e2b3-3d78-41c1-acdf-36ae5f49ebe0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:16.298053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f488e2b3-3d78-41c1-acdf-36ae5f49ebe0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:16.298842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f488e2b3-3d78-41c1-acdf-36ae5f49ebe0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:16.299404 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f488e2b3-3d78-41c1-acdf-36ae5f49ebe0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:16.300020 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f488e2b3-3d78-41c1-acdf-36ae5f49ebe0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:16.449721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f488e2b3-3d78-41c1-acdf-36ae5f49ebe0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:16.462059 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f488e2b3-3d78-41c1-acdf-36ae5f49ebe0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.176569 Sep 17 21:09:16.462876 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 283/552] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:16 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:16.862424 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3564baaf-b77e-4ebc-89f0-90649a5ef67e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:16.863037 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3564baaf-b77e-4ebc-89f0-90649a5ef67e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:16.870182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3564baaf-b77e-4ebc-89f0-90649a5ef67e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:16.871097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3564baaf-b77e-4ebc-89f0-90649a5ef67e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:16.871750 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3564baaf-b77e-4ebc-89f0-90649a5ef67e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:16.872487 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3564baaf-b77e-4ebc-89f0-90649a5ef67e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:16.873266 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3564baaf-b77e-4ebc-89f0-90649a5ef67e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:16.873935 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3564baaf-b77e-4ebc-89f0-90649a5ef67e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:17.022213 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3564baaf-b77e-4ebc-89f0-90649a5ef67e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:17.031921 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3564baaf-b77e-4ebc-89f0-90649a5ef67e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:17.033485 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3564baaf-b77e-4ebc-89f0-90649a5ef67e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:17.034879 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3564baaf-b77e-4ebc-89f0-90649a5ef67e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1739 microversion: 2.20 time: 0.176342 Sep 17 21:09:17.035490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 270/553] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:16 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:17.487429 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f41f683f-f583-4685-b69b-d48f9b059e55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:17.488032 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f41f683f-f583-4685-b69b-d48f9b059e55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:17.496561 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f41f683f-f583-4685-b69b-d48f9b059e55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:17.497656 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f41f683f-f583-4685-b69b-d48f9b059e55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:17.498470 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f41f683f-f583-4685-b69b-d48f9b059e55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:17.499824 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f41f683f-f583-4685-b69b-d48f9b059e55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:17.500480 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f41f683f-f583-4685-b69b-d48f9b059e55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:17.500930 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f41f683f-f583-4685-b69b-d48f9b059e55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:17.651980 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f41f683f-f583-4685-b69b-d48f9b059e55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:17.661277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f41f683f-f583-4685-b69b-d48f9b059e55 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.177680 Sep 17 21:09:17.677311 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 284/554] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:17 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:18.061455 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-db220847-aec0-4bc3-8ae4-7c1cc1ad18f7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:18.062056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-db220847-aec0-4bc3-8ae4-7c1cc1ad18f7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:18.069214 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db220847-aec0-4bc3-8ae4-7c1cc1ad18f7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:18.071101 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db220847-aec0-4bc3-8ae4-7c1cc1ad18f7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:18.071553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db220847-aec0-4bc3-8ae4-7c1cc1ad18f7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:18.072261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db220847-aec0-4bc3-8ae4-7c1cc1ad18f7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:18.072729 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db220847-aec0-4bc3-8ae4-7c1cc1ad18f7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:18.073332 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db220847-aec0-4bc3-8ae4-7c1cc1ad18f7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:18.226539 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-db220847-aec0-4bc3-8ae4-7c1cc1ad18f7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:18.235464 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-db220847-aec0-4bc3-8ae4-7c1cc1ad18f7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:18.237032 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-db220847-aec0-4bc3-8ae4-7c1cc1ad18f7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:18.238342 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-db220847-aec0-4bc3-8ae4-7c1cc1ad18f7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1739 microversion: 2.20 time: 0.180735 Sep 17 21:09:18.239200 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 271/555] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:18 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:18.686732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7ef1a47f-c56a-442d-8de4-9ad5d617952e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:18.687320 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7ef1a47f-c56a-442d-8de4-9ad5d617952e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:18.694169 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ef1a47f-c56a-442d-8de4-9ad5d617952e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:18.694781 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ef1a47f-c56a-442d-8de4-9ad5d617952e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:18.695456 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ef1a47f-c56a-442d-8de4-9ad5d617952e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:18.696155 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ef1a47f-c56a-442d-8de4-9ad5d617952e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:18.696608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ef1a47f-c56a-442d-8de4-9ad5d617952e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:18.697059 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ef1a47f-c56a-442d-8de4-9ad5d617952e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:18.855913 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7ef1a47f-c56a-442d-8de4-9ad5d617952e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:18.865933 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7ef1a47f-c56a-442d-8de4-9ad5d617952e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.183087 Sep 17 21:09:18.881356 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 285/556] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:18 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:19.264639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-59b084a0-73aa-4914-857a-793415588b01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:19.265268 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-59b084a0-73aa-4914-857a-793415588b01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:19.271972 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59b084a0-73aa-4914-857a-793415588b01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:19.272738 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59b084a0-73aa-4914-857a-793415588b01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:19.273261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59b084a0-73aa-4914-857a-793415588b01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:19.273965 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59b084a0-73aa-4914-857a-793415588b01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:19.274689 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59b084a0-73aa-4914-857a-793415588b01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:19.275409 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59b084a0-73aa-4914-857a-793415588b01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:19.495798 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-59b084a0-73aa-4914-857a-793415588b01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:19.504559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-59b084a0-73aa-4914-857a-793415588b01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:19.506213 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-59b084a0-73aa-4914-857a-793415588b01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:19.507439 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-59b084a0-73aa-4914-857a-793415588b01 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1739 microversion: 2.20 time: 0.246702 Sep 17 21:09:19.508063 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 272/557] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:19 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:19.890867 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8330d4f5-a6d4-43e2-8382-3b014c5121bf tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:19.891512 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8330d4f5-a6d4-43e2-8382-3b014c5121bf tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:19.898657 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8330d4f5-a6d4-43e2-8382-3b014c5121bf tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:19.899148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8330d4f5-a6d4-43e2-8382-3b014c5121bf tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:19.899589 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8330d4f5-a6d4-43e2-8382-3b014c5121bf tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:19.900287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8330d4f5-a6d4-43e2-8382-3b014c5121bf tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:19.900772 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8330d4f5-a6d4-43e2-8382-3b014c5121bf tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:19.901207 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8330d4f5-a6d4-43e2-8382-3b014c5121bf tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:20.030554 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8330d4f5-a6d4-43e2-8382-3b014c5121bf tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:20.038971 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8330d4f5-a6d4-43e2-8382-3b014c5121bf tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.151748 Sep 17 21:09:20.039480 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 286/558] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:19 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:20.534262 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5a94e0bf-7465-4bcc-b171-65b701662d17 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:20.534723 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5a94e0bf-7465-4bcc-b171-65b701662d17 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:20.540876 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a94e0bf-7465-4bcc-b171-65b701662d17 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:20.541358 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a94e0bf-7465-4bcc-b171-65b701662d17 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:20.541787 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a94e0bf-7465-4bcc-b171-65b701662d17 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:20.542475 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a94e0bf-7465-4bcc-b171-65b701662d17 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:20.542922 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a94e0bf-7465-4bcc-b171-65b701662d17 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:20.543342 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a94e0bf-7465-4bcc-b171-65b701662d17 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:20.743298 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5a94e0bf-7465-4bcc-b171-65b701662d17 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:20.751409 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5a94e0bf-7465-4bcc-b171-65b701662d17 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:20.752964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5a94e0bf-7465-4bcc-b171-65b701662d17 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:20.754111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5a94e0bf-7465-4bcc-b171-65b701662d17 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1721 microversion: 2.20 time: 0.224275 Sep 17 21:09:20.754667 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 273/559] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:20 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:21.061994 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17bd36d0-0c3d-49b0-87bd-130b6f426f8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:21.062713 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-17bd36d0-0c3d-49b0-87bd-130b6f426f8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:21.069352 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17bd36d0-0c3d-49b0-87bd-130b6f426f8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:21.070536 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17bd36d0-0c3d-49b0-87bd-130b6f426f8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:21.071213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17bd36d0-0c3d-49b0-87bd-130b6f426f8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:21.071921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17bd36d0-0c3d-49b0-87bd-130b6f426f8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:21.072378 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17bd36d0-0c3d-49b0-87bd-130b6f426f8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:21.072835 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17bd36d0-0c3d-49b0-87bd-130b6f426f8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:21.200473 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-17bd36d0-0c3d-49b0-87bd-130b6f426f8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:21.208513 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17bd36d0-0c3d-49b0-87bd-130b6f426f8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.150349 Sep 17 21:09:21.209105 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 287/560] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:21 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:21.780435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1d958da7-1928-418f-8f33-c0a483e89501 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:21.781062 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1d958da7-1928-418f-8f33-c0a483e89501 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:21.787382 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d958da7-1928-418f-8f33-c0a483e89501 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:21.787849 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d958da7-1928-418f-8f33-c0a483e89501 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:21.788920 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d958da7-1928-418f-8f33-c0a483e89501 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:21.789614 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d958da7-1928-418f-8f33-c0a483e89501 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:21.790069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d958da7-1928-418f-8f33-c0a483e89501 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:21.790489 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d958da7-1928-418f-8f33-c0a483e89501 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:21.916442 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1d958da7-1928-418f-8f33-c0a483e89501 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:21.924495 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1d958da7-1928-418f-8f33-c0a483e89501 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:21.925970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1d958da7-1928-418f-8f33-c0a483e89501 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:21.927135 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1d958da7-1928-418f-8f33-c0a483e89501 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1721 microversion: 2.20 time: 0.150617 Sep 17 21:09:21.927691 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 274/561] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:21 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:22.232842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a93ceb7d-e1da-4e4a-a920-b339719fdaba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:22.233442 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a93ceb7d-e1da-4e4a-a920-b339719fdaba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:22.239782 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a93ceb7d-e1da-4e4a-a920-b339719fdaba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:22.240255 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a93ceb7d-e1da-4e4a-a920-b339719fdaba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:22.240697 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a93ceb7d-e1da-4e4a-a920-b339719fdaba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:22.242043 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a93ceb7d-e1da-4e4a-a920-b339719fdaba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:22.242584 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a93ceb7d-e1da-4e4a-a920-b339719fdaba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:22.243009 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a93ceb7d-e1da-4e4a-a920-b339719fdaba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:22.371791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a93ceb7d-e1da-4e4a-a920-b339719fdaba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:22.379932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a93ceb7d-e1da-4e4a-a920-b339719fdaba tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.150998 Sep 17 21:09:22.380483 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 288/562] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:22 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:22.952447 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2a2b092-be36-460e-9d1c-6f0041c0c290 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:22.953080 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b2a2b092-be36-460e-9d1c-6f0041c0c290 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:22.959522 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2a2b092-be36-460e-9d1c-6f0041c0c290 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:22.960005 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2a2b092-be36-460e-9d1c-6f0041c0c290 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:22.960496 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2a2b092-be36-460e-9d1c-6f0041c0c290 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:22.961227 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2a2b092-be36-460e-9d1c-6f0041c0c290 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:22.961684 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2a2b092-be36-460e-9d1c-6f0041c0c290 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:22.962105 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2a2b092-be36-460e-9d1c-6f0041c0c290 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.089725 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2a2b092-be36-460e-9d1c-6f0041c0c290 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:23.097844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2a2b092-be36-460e-9d1c-6f0041c0c290 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:23.099322 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2a2b092-be36-460e-9d1c-6f0041c0c290 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:23.100511 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b2a2b092-be36-460e-9d1c-6f0041c0c290 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1724 microversion: 2.20 time: 0.152018 Sep 17 21:09:23.101698 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 275/563] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:22 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:23.126300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae78fd84-de72-40fb-b497-aa980d2eaf9f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12d4c6b0-ea1b-4c0a-83c6-7d3534313bdf"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:23.128832 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae78fd84-de72-40fb-b497-aa980d2eaf9f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:23.134907 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae78fd84-de72-40fb-b497-aa980d2eaf9f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:23.135400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae78fd84-de72-40fb-b497-aa980d2eaf9f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:23.135836 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae78fd84-de72-40fb-b497-aa980d2eaf9f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.136528 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae78fd84-de72-40fb-b497-aa980d2eaf9f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:23.137005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae78fd84-de72-40fb-b497-aa980d2eaf9f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:23.137850 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae78fd84-de72-40fb-b497-aa980d2eaf9f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.404567 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b27bd591-6af5-459b-90ec-3a98de1fbd02 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:23.405519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b27bd591-6af5-459b-90ec-3a98de1fbd02 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:23.411562 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b27bd591-6af5-459b-90ec-3a98de1fbd02 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:23.412045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b27bd591-6af5-459b-90ec-3a98de1fbd02 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:23.412477 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b27bd591-6af5-459b-90ec-3a98de1fbd02 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.413226 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b27bd591-6af5-459b-90ec-3a98de1fbd02 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:23.414193 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b27bd591-6af5-459b-90ec-3a98de1fbd02 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:23.414638 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b27bd591-6af5-459b-90ec-3a98de1fbd02 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.430995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae78fd84-de72-40fb-b497-aa980d2eaf9f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "POST /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308499 Sep 17 21:09:23.437156 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 289/564] 10.222.0.16 () {62 vars in 1364 bytes} [Sat Sep 17 21:09:23 2022] POST /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:09:23.546018 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b27bd591-6af5-459b-90ec-3a98de1fbd02 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:23.555362 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b27bd591-6af5-459b-90ec-3a98de1fbd02 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.154804 Sep 17 21:09:23.555931 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 276/565] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:23 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:23.559770 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea4990d9-5f5a-4bd5-a5e2-691ead9e36c2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:23.560296 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea4990d9-5f5a-4bd5-a5e2-691ead9e36c2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:23.566164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4990d9-5f5a-4bd5-a5e2-691ead9e36c2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:23.566642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4990d9-5f5a-4bd5-a5e2-691ead9e36c2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:23.567074 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4990d9-5f5a-4bd5-a5e2-691ead9e36c2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.567755 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4990d9-5f5a-4bd5-a5e2-691ead9e36c2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:23.568204 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4990d9-5f5a-4bd5-a5e2-691ead9e36c2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:23.568894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4990d9-5f5a-4bd5-a5e2-691ead9e36c2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.615469 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea4990d9-5f5a-4bd5-a5e2-691ead9e36c2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120587) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 17 21:09:23.684557 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea4990d9-5f5a-4bd5-a5e2-691ead9e36c2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "POST /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/action" status: 202 len: 0 microversion: 2.20 time: 0.128677 Sep 17 21:09:23.685486 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 290/566] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 17 21:09:23 2022] POST /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:09:23.694612 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-99f07221-b9fc-4e38-a871-a1a58ff69ce3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:23.696091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99f07221-b9fc-4e38-a871-a1a58ff69ce3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:23.703632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99f07221-b9fc-4e38-a871-a1a58ff69ce3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:23.704484 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99f07221-b9fc-4e38-a871-a1a58ff69ce3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:23.705225 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99f07221-b9fc-4e38-a871-a1a58ff69ce3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.706120 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99f07221-b9fc-4e38-a871-a1a58ff69ce3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:23.706733 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99f07221-b9fc-4e38-a871-a1a58ff69ce3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:23.707317 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99f07221-b9fc-4e38-a871-a1a58ff69ce3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.839252 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-99f07221-b9fc-4e38-a871-a1a58ff69ce3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:23.847748 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-99f07221-b9fc-4e38-a871-a1a58ff69ce3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:23.849202 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-99f07221-b9fc-4e38-a871-a1a58ff69ce3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:23.850349 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-99f07221-b9fc-4e38-a871-a1a58ff69ce3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1810 microversion: 2.20 time: 0.160590 Sep 17 21:09:23.851481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 277/567] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:23 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:24.408583 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ea108f99-8bd4-4fa5-b9ed-5c05febbe47d req-c54d6880-dccd-4788-9f7d-943fb8e6ce56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785212fb-7493-49ce-b3f0-12b3742b3a88", "name": "network-vif-unplugged", "status": "completed", "tag": "3a9a1b04-a0c4-4a66-a693-a268f50c530b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:24.423625 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ea108f99-8bd4-4fa5-b9ed-5c05febbe47d req-c54d6880-dccd-4788-9f7d-943fb8e6ce56 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:24.424106 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ea108f99-8bd4-4fa5-b9ed-5c05febbe47d req-c54d6880-dccd-4788-9f7d-943fb8e6ce56 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:24.424772 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ea108f99-8bd4-4fa5-b9ed-5c05febbe47d req-c54d6880-dccd-4788-9f7d-943fb8e6ce56 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:24.437107 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.compute.server_external_events [req-ea108f99-8bd4-4fa5-b9ed-5c05febbe47d req-c54d6880-dccd-4788-9f7d-943fb8e6ce56 service nova] Unable to find a host for instance 785212fb-7493-49ce-b3f0-12b3742b3a88. Dropping event network-vif-unplugged {{(pid=120587) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 17 21:09:24.438061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ea108f99-8bd4-4fa5-b9ed-5c05febbe47d req-c54d6880-dccd-4788-9f7d-943fb8e6ce56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034847 Sep 17 21:09:24.438916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 291/568] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 17 21:09:24.579816 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5eb9c404-dd80-4054-9c8a-feae840aad9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:24.580481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5eb9c404-dd80-4054-9c8a-feae840aad9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:24.587041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5eb9c404-dd80-4054-9c8a-feae840aad9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:24.587526 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5eb9c404-dd80-4054-9c8a-feae840aad9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:24.587959 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5eb9c404-dd80-4054-9c8a-feae840aad9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:24.588659 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5eb9c404-dd80-4054-9c8a-feae840aad9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:24.589136 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5eb9c404-dd80-4054-9c8a-feae840aad9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:24.589742 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5eb9c404-dd80-4054-9c8a-feae840aad9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:24.720770 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5eb9c404-dd80-4054-9c8a-feae840aad9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:24.729434 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5eb9c404-dd80-4054-9c8a-feae840aad9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.153588 Sep 17 21:09:24.730399 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 278/569] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:24 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:24.876752 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-68fa5668-7c0d-48d2-80d3-f9dc2190656e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:24.877419 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-68fa5668-7c0d-48d2-80d3-f9dc2190656e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:24.884163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68fa5668-7c0d-48d2-80d3-f9dc2190656e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:24.884648 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68fa5668-7c0d-48d2-80d3-f9dc2190656e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:24.885115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68fa5668-7c0d-48d2-80d3-f9dc2190656e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:24.885813 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68fa5668-7c0d-48d2-80d3-f9dc2190656e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:24.886273 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68fa5668-7c0d-48d2-80d3-f9dc2190656e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:24.886697 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68fa5668-7c0d-48d2-80d3-f9dc2190656e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:25.015580 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-68fa5668-7c0d-48d2-80d3-f9dc2190656e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:25.024024 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-68fa5668-7c0d-48d2-80d3-f9dc2190656e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:25.025441 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-68fa5668-7c0d-48d2-80d3-f9dc2190656e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:25.026573 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-68fa5668-7c0d-48d2-80d3-f9dc2190656e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1752 microversion: 2.20 time: 0.153776 Sep 17 21:09:25.027126 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 292/570] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:24 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:25.754963 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0fa67fe6-248d-4ef4-a194-d0892c28d03b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:25.755500 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0fa67fe6-248d-4ef4-a194-d0892c28d03b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:25.762000 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fa67fe6-248d-4ef4-a194-d0892c28d03b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:25.762481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fa67fe6-248d-4ef4-a194-d0892c28d03b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:25.762917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fa67fe6-248d-4ef4-a194-d0892c28d03b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:25.763605 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fa67fe6-248d-4ef4-a194-d0892c28d03b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:25.764057 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fa67fe6-248d-4ef4-a194-d0892c28d03b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:25.764482 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fa67fe6-248d-4ef4-a194-d0892c28d03b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:25.960644 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0fa67fe6-248d-4ef4-a194-d0892c28d03b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:25.969374 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0fa67fe6-248d-4ef4-a194-d0892c28d03b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.218332 Sep 17 21:09:25.969939 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 279/571] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:25 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:26.051334 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-afd8def5-7db0-478d-828a-0dccf0cbb33e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:26.052106 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-afd8def5-7db0-478d-828a-0dccf0cbb33e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:26.058890 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afd8def5-7db0-478d-828a-0dccf0cbb33e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:26.059369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afd8def5-7db0-478d-828a-0dccf0cbb33e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:26.059801 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afd8def5-7db0-478d-828a-0dccf0cbb33e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:26.060489 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afd8def5-7db0-478d-828a-0dccf0cbb33e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:26.060965 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afd8def5-7db0-478d-828a-0dccf0cbb33e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:26.061386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afd8def5-7db0-478d-828a-0dccf0cbb33e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:26.281346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-afd8def5-7db0-478d-828a-0dccf0cbb33e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:26.283529 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:26.292603 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-afd8def5-7db0-478d-828a-0dccf0cbb33e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:26.294114 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-afd8def5-7db0-478d-828a-0dccf0cbb33e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:26.295401 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-afd8def5-7db0-478d-828a-0dccf0cbb33e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.247883 Sep 17 21:09:26.295955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 293/572] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:26 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:26.993516 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64ac40d3-226c-40ab-af24-9752daa45e37 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:26.994321 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64ac40d3-226c-40ab-af24-9752daa45e37 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:27.002248 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64ac40d3-226c-40ab-af24-9752daa45e37 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:27.003521 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64ac40d3-226c-40ab-af24-9752daa45e37 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:27.004127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64ac40d3-226c-40ab-af24-9752daa45e37 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:27.005187 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64ac40d3-226c-40ab-af24-9752daa45e37 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:27.005790 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64ac40d3-226c-40ab-af24-9752daa45e37 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:27.006361 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64ac40d3-226c-40ab-af24-9752daa45e37 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:27.153858 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-64ac40d3-226c-40ab-af24-9752daa45e37 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:27.163481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64ac40d3-226c-40ab-af24-9752daa45e37 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.175308 Sep 17 21:09:27.164912 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 280/573] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:26 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:27.322078 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a673ee4-d0c2-4c9b-96aa-887849579ec4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:27.322680 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a673ee4-d0c2-4c9b-96aa-887849579ec4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:27.330027 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a673ee4-d0c2-4c9b-96aa-887849579ec4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:27.330515 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a673ee4-d0c2-4c9b-96aa-887849579ec4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:27.331113 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a673ee4-d0c2-4c9b-96aa-887849579ec4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:27.331639 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a673ee4-d0c2-4c9b-96aa-887849579ec4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:27.332088 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a673ee4-d0c2-4c9b-96aa-887849579ec4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:27.332508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a673ee4-d0c2-4c9b-96aa-887849579ec4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:27.485438 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a673ee4-d0c2-4c9b-96aa-887849579ec4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:27.495023 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a673ee4-d0c2-4c9b-96aa-887849579ec4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:27.496545 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a673ee4-d0c2-4c9b-96aa-887849579ec4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:27.497768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a673ee4-d0c2-4c9b-96aa-887849579ec4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.180795 Sep 17 21:09:27.498312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 294/574] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:27 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:28.294530 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a6cd1add-737a-4aeb-9d4c-1e0314dc086f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:28.295144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a6cd1add-737a-4aeb-9d4c-1e0314dc086f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:28.301106 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6cd1add-737a-4aeb-9d4c-1e0314dc086f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:28.301589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6cd1add-737a-4aeb-9d4c-1e0314dc086f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:28.302021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6cd1add-737a-4aeb-9d4c-1e0314dc086f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:28.302716 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6cd1add-737a-4aeb-9d4c-1e0314dc086f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:28.303165 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6cd1add-737a-4aeb-9d4c-1e0314dc086f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:28.303614 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6cd1add-737a-4aeb-9d4c-1e0314dc086f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:28.524633 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c23cfb2c-8f9c-4fb3-b16c-88707807b340 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:28.525202 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c23cfb2c-8f9c-4fb3-b16c-88707807b340 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:28.532771 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c23cfb2c-8f9c-4fb3-b16c-88707807b340 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:28.533371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c23cfb2c-8f9c-4fb3-b16c-88707807b340 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:28.533881 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c23cfb2c-8f9c-4fb3-b16c-88707807b340 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:28.534692 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c23cfb2c-8f9c-4fb3-b16c-88707807b340 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:28.535221 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c23cfb2c-8f9c-4fb3-b16c-88707807b340 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:28.535715 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c23cfb2c-8f9c-4fb3-b16c-88707807b340 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:28.741133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a6cd1add-737a-4aeb-9d4c-1e0314dc086f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:28.744615 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:28.750939 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a6cd1add-737a-4aeb-9d4c-1e0314dc086f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.566929 Sep 17 21:09:28.777321 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 281/575] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:28 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:28.790350 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c23cfb2c-8f9c-4fb3-b16c-88707807b340 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:28.799398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c23cfb2c-8f9c-4fb3-b16c-88707807b340 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:28.800888 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c23cfb2c-8f9c-4fb3-b16c-88707807b340 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:28.802079 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c23cfb2c-8f9c-4fb3-b16c-88707807b340 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.282314 Sep 17 21:09:28.802622 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 295/576] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:28 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:29.786323 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6db61034-b178-4e33-b7f4-5fbbc0ef28ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:29.787012 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6db61034-b178-4e33-b7f4-5fbbc0ef28ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:29.794954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6db61034-b178-4e33-b7f4-5fbbc0ef28ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:29.795447 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6db61034-b178-4e33-b7f4-5fbbc0ef28ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:29.795880 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6db61034-b178-4e33-b7f4-5fbbc0ef28ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:29.796604 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6db61034-b178-4e33-b7f4-5fbbc0ef28ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:29.797078 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6db61034-b178-4e33-b7f4-5fbbc0ef28ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:29.797498 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6db61034-b178-4e33-b7f4-5fbbc0ef28ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:29.828473 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-548fbb7d-3410-4b8b-8566-b94320da1998 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:29.829375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-548fbb7d-3410-4b8b-8566-b94320da1998 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:29.839602 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-548fbb7d-3410-4b8b-8566-b94320da1998 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:29.843207 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-548fbb7d-3410-4b8b-8566-b94320da1998 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:29.843993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-548fbb7d-3410-4b8b-8566-b94320da1998 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:29.844875 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-548fbb7d-3410-4b8b-8566-b94320da1998 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:29.845593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-548fbb7d-3410-4b8b-8566-b94320da1998 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:29.846120 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-548fbb7d-3410-4b8b-8566-b94320da1998 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:29.984502 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6db61034-b178-4e33-b7f4-5fbbc0ef28ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:29.994425 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6db61034-b178-4e33-b7f4-5fbbc0ef28ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.212494 Sep 17 21:09:29.995346 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 282/577] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:29 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:30.026375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-548fbb7d-3410-4b8b-8566-b94320da1998 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:30.037026 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-548fbb7d-3410-4b8b-8566-b94320da1998 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:30.040312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-548fbb7d-3410-4b8b-8566-b94320da1998 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:30.042326 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-548fbb7d-3410-4b8b-8566-b94320da1998 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.217702 Sep 17 21:09:30.052697 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 296/578] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:29 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:31.021883 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2ed05b1-3fa7-4426-8665-71d7bb650c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:31.022482 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2ed05b1-3fa7-4426-8665-71d7bb650c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:31.029368 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ed05b1-3fa7-4426-8665-71d7bb650c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:31.032275 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ed05b1-3fa7-4426-8665-71d7bb650c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:31.032275 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ed05b1-3fa7-4426-8665-71d7bb650c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:31.032275 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ed05b1-3fa7-4426-8665-71d7bb650c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:31.032275 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ed05b1-3fa7-4426-8665-71d7bb650c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:31.032703 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ed05b1-3fa7-4426-8665-71d7bb650c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:31.068251 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-48732d20-6e82-4c76-ad52-d0143bb2ca4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:31.069136 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-48732d20-6e82-4c76-ad52-d0143bb2ca4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:31.075708 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48732d20-6e82-4c76-ad52-d0143bb2ca4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:31.076193 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48732d20-6e82-4c76-ad52-d0143bb2ca4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:31.076623 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48732d20-6e82-4c76-ad52-d0143bb2ca4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:31.077355 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48732d20-6e82-4c76-ad52-d0143bb2ca4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:31.077804 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48732d20-6e82-4c76-ad52-d0143bb2ca4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:31.078219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48732d20-6e82-4c76-ad52-d0143bb2ca4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:31.238395 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d2ed05b1-3fa7-4426-8665-71d7bb650c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:31.248575 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2ed05b1-3fa7-4426-8665-71d7bb650c04 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.230384 Sep 17 21:09:31.249326 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 283/579] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:31 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:31.265854 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-48732d20-6e82-4c76-ad52-d0143bb2ca4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:31.275400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-48732d20-6e82-4c76-ad52-d0143bb2ca4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:31.276872 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-48732d20-6e82-4c76-ad52-d0143bb2ca4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:31.278052 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-48732d20-6e82-4c76-ad52-d0143bb2ca4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.213496 Sep 17 21:09:31.278611 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 297/580] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:31 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:32.276315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f39eddf-8711-466f-8adb-cb84293dded0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:32.277368 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2f39eddf-8711-466f-8adb-cb84293dded0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:32.289023 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f39eddf-8711-466f-8adb-cb84293dded0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:32.290943 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f39eddf-8711-466f-8adb-cb84293dded0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:32.291733 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f39eddf-8711-466f-8adb-cb84293dded0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:32.293117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f39eddf-8711-466f-8adb-cb84293dded0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:32.294130 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f39eddf-8711-466f-8adb-cb84293dded0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:32.294936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f39eddf-8711-466f-8adb-cb84293dded0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:32.314465 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0c495c35-597d-44cd-9900-48c831178ac8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:32.315502 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0c495c35-597d-44cd-9900-48c831178ac8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:32.327662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c495c35-597d-44cd-9900-48c831178ac8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:32.328663 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c495c35-597d-44cd-9900-48c831178ac8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:32.329967 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c495c35-597d-44cd-9900-48c831178ac8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:32.330821 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c495c35-597d-44cd-9900-48c831178ac8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:32.331903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c495c35-597d-44cd-9900-48c831178ac8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:32.332653 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c495c35-597d-44cd-9900-48c831178ac8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:32.516856 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f39eddf-8711-466f-8adb-cb84293dded0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:32.525079 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2f39eddf-8711-466f-8adb-cb84293dded0 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.255701 Sep 17 21:09:32.526240 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 284/581] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:32 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:32.528287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c495c35-597d-44cd-9900-48c831178ac8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:32.537945 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c495c35-597d-44cd-9900-48c831178ac8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:32.540431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c495c35-597d-44cd-9900-48c831178ac8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:32.542111 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0c495c35-597d-44cd-9900-48c831178ac8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.240012 Sep 17 21:09:32.543236 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 298/582] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:32 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:33.550949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8aa80451-66c8-47b4-a493-7e5cad61ad89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:33.551683 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8aa80451-66c8-47b4-a493-7e5cad61ad89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:33.559481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8aa80451-66c8-47b4-a493-7e5cad61ad89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:33.559971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8aa80451-66c8-47b4-a493-7e5cad61ad89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:33.560402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8aa80451-66c8-47b4-a493-7e5cad61ad89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:33.561129 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8aa80451-66c8-47b4-a493-7e5cad61ad89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:33.561579 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8aa80451-66c8-47b4-a493-7e5cad61ad89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:33.562005 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8aa80451-66c8-47b4-a493-7e5cad61ad89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:33.574641 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d39edfab-7b11-4137-a2b9-00cf3a632e24 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:33.576179 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d39edfab-7b11-4137-a2b9-00cf3a632e24 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:33.585306 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d39edfab-7b11-4137-a2b9-00cf3a632e24 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:33.585801 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d39edfab-7b11-4137-a2b9-00cf3a632e24 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:33.586235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d39edfab-7b11-4137-a2b9-00cf3a632e24 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:33.587143 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d39edfab-7b11-4137-a2b9-00cf3a632e24 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:33.587760 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d39edfab-7b11-4137-a2b9-00cf3a632e24 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:33.588192 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d39edfab-7b11-4137-a2b9-00cf3a632e24 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:33.756255 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8aa80451-66c8-47b4-a493-7e5cad61ad89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:33.768540 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8aa80451-66c8-47b4-a493-7e5cad61ad89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.222300 Sep 17 21:09:33.769483 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 285/583] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:33 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:33.790389 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d39edfab-7b11-4137-a2b9-00cf3a632e24 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:33.799491 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d39edfab-7b11-4137-a2b9-00cf3a632e24 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:33.801371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d39edfab-7b11-4137-a2b9-00cf3a632e24 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:33.802470 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d39edfab-7b11-4137-a2b9-00cf3a632e24 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.233596 Sep 17 21:09:33.803022 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 299/584] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:33 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:34.791826 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a3b496f1-5936-4796-8f61-a928e436e11f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:34.792544 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a3b496f1-5936-4796-8f61-a928e436e11f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:34.799479 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3b496f1-5936-4796-8f61-a928e436e11f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:34.800059 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3b496f1-5936-4796-8f61-a928e436e11f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:34.800573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3b496f1-5936-4796-8f61-a928e436e11f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:34.801406 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3b496f1-5936-4796-8f61-a928e436e11f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:34.801961 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3b496f1-5936-4796-8f61-a928e436e11f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:34.802481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3b496f1-5936-4796-8f61-a928e436e11f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:34.828805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-caf17a72-8d00-40c8-a875-8b5f47f99c2d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:34.829414 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-caf17a72-8d00-40c8-a875-8b5f47f99c2d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:34.836407 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-caf17a72-8d00-40c8-a875-8b5f47f99c2d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:34.837910 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-caf17a72-8d00-40c8-a875-8b5f47f99c2d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:34.838472 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-caf17a72-8d00-40c8-a875-8b5f47f99c2d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:34.839182 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-caf17a72-8d00-40c8-a875-8b5f47f99c2d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:34.839644 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-caf17a72-8d00-40c8-a875-8b5f47f99c2d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:34.840075 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-caf17a72-8d00-40c8-a875-8b5f47f99c2d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:35.044205 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a3b496f1-5936-4796-8f61-a928e436e11f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:35.048174 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-caf17a72-8d00-40c8-a875-8b5f47f99c2d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:35.052796 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a3b496f1-5936-4796-8f61-a928e436e11f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.264857 Sep 17 21:09:35.053598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 286/585] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:34 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:35.058169 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-caf17a72-8d00-40c8-a875-8b5f47f99c2d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:35.059712 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-caf17a72-8d00-40c8-a875-8b5f47f99c2d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:35.061050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-caf17a72-8d00-40c8-a875-8b5f47f99c2d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.236075 Sep 17 21:09:35.061897 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 300/586] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:34 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:36.077121 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c2d016f0-e65d-4581-901d-1973558b2316 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:36.077727 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c2d016f0-e65d-4581-901d-1973558b2316 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:36.084751 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2d016f0-e65d-4581-901d-1973558b2316 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:36.085244 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2d016f0-e65d-4581-901d-1973558b2316 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:36.085677 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2d016f0-e65d-4581-901d-1973558b2316 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:36.086374 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2d016f0-e65d-4581-901d-1973558b2316 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:36.086826 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2d016f0-e65d-4581-901d-1973558b2316 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:36.087254 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2d016f0-e65d-4581-901d-1973558b2316 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:36.088413 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a353e31-cb22-441c-9cc0-c35d8ada57ac tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:36.089416 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1a353e31-cb22-441c-9cc0-c35d8ada57ac tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:36.098732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a353e31-cb22-441c-9cc0-c35d8ada57ac tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:36.099489 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a353e31-cb22-441c-9cc0-c35d8ada57ac tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:36.100004 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a353e31-cb22-441c-9cc0-c35d8ada57ac tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:36.100826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a353e31-cb22-441c-9cc0-c35d8ada57ac tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:36.101511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a353e31-cb22-441c-9cc0-c35d8ada57ac tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:36.102531 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a353e31-cb22-441c-9cc0-c35d8ada57ac tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:36.293709 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c2d016f0-e65d-4581-901d-1973558b2316 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:36.301411 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a353e31-cb22-441c-9cc0-c35d8ada57ac tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:36.302426 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c2d016f0-e65d-4581-901d-1973558b2316 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.229090 Sep 17 21:09:36.303094 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 287/587] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:36 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:36.312761 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a353e31-cb22-441c-9cc0-c35d8ada57ac tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:36.314315 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a353e31-cb22-441c-9cc0-c35d8ada57ac tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:36.315556 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a353e31-cb22-441c-9cc0-c35d8ada57ac tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.232553 Sep 17 21:09:36.316405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 301/588] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:36 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:37.327906 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b6ab5ce2-0be5-4973-822e-32002c8a2e9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:37.328446 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b6ab5ce2-0be5-4973-822e-32002c8a2e9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:37.336241 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6ab5ce2-0be5-4973-822e-32002c8a2e9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:37.336593 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6ab5ce2-0be5-4973-822e-32002c8a2e9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:37.337063 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6ab5ce2-0be5-4973-822e-32002c8a2e9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:37.337766 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6ab5ce2-0be5-4973-822e-32002c8a2e9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:37.338427 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6ab5ce2-0be5-4973-822e-32002c8a2e9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:37.338851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6ab5ce2-0be5-4973-822e-32002c8a2e9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:37.341528 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f4142fe-589e-4ce2-b8bf-e52c5ff1b446 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:37.342137 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f4142fe-589e-4ce2-b8bf-e52c5ff1b446 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:37.348770 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f4142fe-589e-4ce2-b8bf-e52c5ff1b446 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:37.349268 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f4142fe-589e-4ce2-b8bf-e52c5ff1b446 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:37.349709 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f4142fe-589e-4ce2-b8bf-e52c5ff1b446 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:37.350419 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f4142fe-589e-4ce2-b8bf-e52c5ff1b446 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:37.350875 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f4142fe-589e-4ce2-b8bf-e52c5ff1b446 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:37.351302 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f4142fe-589e-4ce2-b8bf-e52c5ff1b446 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:37.538075 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f4142fe-589e-4ce2-b8bf-e52c5ff1b446 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:37.549001 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f4142fe-589e-4ce2-b8bf-e52c5ff1b446 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:37.549789 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b6ab5ce2-0be5-4973-822e-32002c8a2e9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:37.550452 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f4142fe-589e-4ce2-b8bf-e52c5ff1b446 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:37.551682 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f4142fe-589e-4ce2-b8bf-e52c5ff1b446 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.213993 Sep 17 21:09:37.552241 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 302/589] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:37 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:37.558637 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b6ab5ce2-0be5-4973-822e-32002c8a2e9b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.234761 Sep 17 21:09:37.559185 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 288/590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:37 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:38.578116 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-663ba58e-06b7-40a9-9316-416cc9da8db9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:38.578643 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-663ba58e-06b7-40a9-9316-416cc9da8db9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:38.582295 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d43e809-0187-4db0-8548-ff45be4a8f7a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:38.582913 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d43e809-0187-4db0-8548-ff45be4a8f7a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:38.585177 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-663ba58e-06b7-40a9-9316-416cc9da8db9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:38.585656 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-663ba58e-06b7-40a9-9316-416cc9da8db9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:38.586087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-663ba58e-06b7-40a9-9316-416cc9da8db9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:38.587362 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-663ba58e-06b7-40a9-9316-416cc9da8db9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:38.587813 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-663ba58e-06b7-40a9-9316-416cc9da8db9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:38.588232 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-663ba58e-06b7-40a9-9316-416cc9da8db9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:38.590350 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d43e809-0187-4db0-8548-ff45be4a8f7a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:38.590838 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d43e809-0187-4db0-8548-ff45be4a8f7a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:38.591275 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d43e809-0187-4db0-8548-ff45be4a8f7a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:38.591974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d43e809-0187-4db0-8548-ff45be4a8f7a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:38.592436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d43e809-0187-4db0-8548-ff45be4a8f7a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:38.592895 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d43e809-0187-4db0-8548-ff45be4a8f7a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:38.782140 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-663ba58e-06b7-40a9-9316-416cc9da8db9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:38.784890 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d43e809-0187-4db0-8548-ff45be4a8f7a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:38.791006 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-663ba58e-06b7-40a9-9316-416cc9da8db9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:38.792428 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-663ba58e-06b7-40a9-9316-416cc9da8db9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:38.793338 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d43e809-0187-4db0-8548-ff45be4a8f7a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.214870 Sep 17 21:09:38.793595 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-663ba58e-06b7-40a9-9316-416cc9da8db9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.219475 Sep 17 21:09:38.793903 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 289/591] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:38 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:38.794136 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 303/592] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:38 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:39.817251 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-177884b6-3fae-47a4-9068-57a98626fe89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:39.817853 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-177884b6-3fae-47a4-9068-57a98626fe89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:39.818953 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d20aca9-1cb9-4b37-8096-2398b382f928 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:39.819587 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3d20aca9-1cb9-4b37-8096-2398b382f928 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:39.824548 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-177884b6-3fae-47a4-9068-57a98626fe89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:39.825055 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-177884b6-3fae-47a4-9068-57a98626fe89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:39.825505 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-177884b6-3fae-47a4-9068-57a98626fe89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:39.825955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d20aca9-1cb9-4b37-8096-2398b382f928 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:39.826195 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-177884b6-3fae-47a4-9068-57a98626fe89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:39.826438 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d20aca9-1cb9-4b37-8096-2398b382f928 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:39.826645 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-177884b6-3fae-47a4-9068-57a98626fe89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:39.826864 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d20aca9-1cb9-4b37-8096-2398b382f928 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:39.827063 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-177884b6-3fae-47a4-9068-57a98626fe89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:39.827546 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d20aca9-1cb9-4b37-8096-2398b382f928 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:39.827996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d20aca9-1cb9-4b37-8096-2398b382f928 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:39.828416 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d20aca9-1cb9-4b37-8096-2398b382f928 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:40.020621 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-177884b6-3fae-47a4-9068-57a98626fe89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:40.024329 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3d20aca9-1cb9-4b37-8096-2398b382f928 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:40.031129 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-177884b6-3fae-47a4-9068-57a98626fe89 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.217741 Sep 17 21:09:40.031925 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 290/593] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:39 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:40.039112 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3d20aca9-1cb9-4b37-8096-2398b382f928 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:40.041705 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3d20aca9-1cb9-4b37-8096-2398b382f928 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:40.042873 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3d20aca9-1cb9-4b37-8096-2398b382f928 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.227973 Sep 17 21:09:40.043419 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 304/594] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:39 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:41.054799 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-809fae9c-001d-442e-8c1c-0a164fc8b7ff tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:41.055906 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-809fae9c-001d-442e-8c1c-0a164fc8b7ff tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:41.062209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-809fae9c-001d-442e-8c1c-0a164fc8b7ff tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:41.062694 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-809fae9c-001d-442e-8c1c-0a164fc8b7ff tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:41.063123 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-809fae9c-001d-442e-8c1c-0a164fc8b7ff tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:41.063811 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-809fae9c-001d-442e-8c1c-0a164fc8b7ff tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:41.064263 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-809fae9c-001d-442e-8c1c-0a164fc8b7ff tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:41.064701 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-809fae9c-001d-442e-8c1c-0a164fc8b7ff tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:41.068207 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ef25c0a4-42cb-449c-a27f-5c07decb5cb3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:41.069102 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ef25c0a4-42cb-449c-a27f-5c07decb5cb3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:41.076084 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef25c0a4-42cb-449c-a27f-5c07decb5cb3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:41.076566 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef25c0a4-42cb-449c-a27f-5c07decb5cb3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:41.077039 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef25c0a4-42cb-449c-a27f-5c07decb5cb3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:41.077734 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef25c0a4-42cb-449c-a27f-5c07decb5cb3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:41.078187 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef25c0a4-42cb-449c-a27f-5c07decb5cb3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:41.078610 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef25c0a4-42cb-449c-a27f-5c07decb5cb3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:41.267453 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-809fae9c-001d-442e-8c1c-0a164fc8b7ff tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:41.271841 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ef25c0a4-42cb-449c-a27f-5c07decb5cb3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:41.275971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-809fae9c-001d-442e-8c1c-0a164fc8b7ff tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.224955 Sep 17 21:09:41.276533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 291/595] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:41 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:41.280734 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ef25c0a4-42cb-449c-a27f-5c07decb5cb3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:41.282163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ef25c0a4-42cb-449c-a27f-5c07decb5cb3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:41.283307 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ef25c0a4-42cb-449c-a27f-5c07decb5cb3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.218876 Sep 17 21:09:41.283845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 305/596] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:41 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:42.299279 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ec75bb4-06e5-46d8-a0d0-67875504bbb1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:42.299889 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0ec75bb4-06e5-46d8-a0d0-67875504bbb1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:42.307262 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ec75bb4-06e5-46d8-a0d0-67875504bbb1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:42.307748 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ec75bb4-06e5-46d8-a0d0-67875504bbb1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:42.308187 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ec75bb4-06e5-46d8-a0d0-67875504bbb1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:42.308925 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ec75bb4-06e5-46d8-a0d0-67875504bbb1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:42.309390 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ec75bb4-06e5-46d8-a0d0-67875504bbb1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:42.309779 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-56a83f28-d142-49f7-91af-545ee4e17284 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:42.310174 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ec75bb4-06e5-46d8-a0d0-67875504bbb1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:42.310385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-56a83f28-d142-49f7-91af-545ee4e17284 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:42.317088 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56a83f28-d142-49f7-91af-545ee4e17284 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:42.317654 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56a83f28-d142-49f7-91af-545ee4e17284 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:42.319194 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56a83f28-d142-49f7-91af-545ee4e17284 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:42.320080 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56a83f28-d142-49f7-91af-545ee4e17284 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:42.320560 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56a83f28-d142-49f7-91af-545ee4e17284 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:42.321005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56a83f28-d142-49f7-91af-545ee4e17284 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:42.500314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0ec75bb4-06e5-46d8-a0d0-67875504bbb1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:42.509936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0ec75bb4-06e5-46d8-a0d0-67875504bbb1 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.214458 Sep 17 21:09:42.512298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-56a83f28-d142-49f7-91af-545ee4e17284 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:42.513902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 292/597] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:42 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:42.521497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-56a83f28-d142-49f7-91af-545ee4e17284 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:42.522949 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-56a83f28-d142-49f7-91af-545ee4e17284 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:42.524828 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-56a83f28-d142-49f7-91af-545ee4e17284 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.219534 Sep 17 21:09:42.525514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 306/598] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:42 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:43.537471 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ebcb8ac4-09b0-41cc-9ea8-8329bbbe4896 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:43.538079 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ebcb8ac4-09b0-41cc-9ea8-8329bbbe4896 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:43.544939 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebcb8ac4-09b0-41cc-9ea8-8329bbbe4896 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.545419 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebcb8ac4-09b0-41cc-9ea8-8329bbbe4896 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.545853 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebcb8ac4-09b0-41cc-9ea8-8329bbbe4896 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.546551 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebcb8ac4-09b0-41cc-9ea8-8329bbbe4896 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.547004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebcb8ac4-09b0-41cc-9ea8-8329bbbe4896 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.547427 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebcb8ac4-09b0-41cc-9ea8-8329bbbe4896 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.551219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bb2abd63-3e62-41af-9fbc-3327aaa0d248 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:43.551822 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bb2abd63-3e62-41af-9fbc-3327aaa0d248 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:43.554106 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:43.559835 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb2abd63-3e62-41af-9fbc-3327aaa0d248 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.560317 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb2abd63-3e62-41af-9fbc-3327aaa0d248 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.560805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb2abd63-3e62-41af-9fbc-3327aaa0d248 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.561502 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb2abd63-3e62-41af-9fbc-3327aaa0d248 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.561952 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb2abd63-3e62-41af-9fbc-3327aaa0d248 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.562372 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb2abd63-3e62-41af-9fbc-3327aaa0d248 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.747890 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ebcb8ac4-09b0-41cc-9ea8-8329bbbe4896 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:43.750928 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bb2abd63-3e62-41af-9fbc-3327aaa0d248 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:43.756321 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ebcb8ac4-09b0-41cc-9ea8-8329bbbe4896 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.222647 Sep 17 21:09:43.756982 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 293/599] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:43 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:43.759403 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bb2abd63-3e62-41af-9fbc-3327aaa0d248 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:43.760855 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bb2abd63-3e62-41af-9fbc-3327aaa0d248 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:43.762001 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bb2abd63-3e62-41af-9fbc-3327aaa0d248 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.214696 Sep 17 21:09:43.762544 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 307/600] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:43 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:43.887179 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a674483-bd80-499a-a6ad-fd6c97d2a4e1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:43.887702 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a674483-bd80-499a-a6ad-fd6c97d2a4e1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:43.893603 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a674483-bd80-499a-a6ad-fd6c97d2a4e1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.894083 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a674483-bd80-499a-a6ad-fd6c97d2a4e1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.894513 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a674483-bd80-499a-a6ad-fd6c97d2a4e1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.895196 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a674483-bd80-499a-a6ad-fd6c97d2a4e1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.895651 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a674483-bd80-499a-a6ad-fd6c97d2a4e1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.896073 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a674483-bd80-499a-a6ad-fd6c97d2a4e1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:44.022330 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-9a674483-bd80-499a-a6ad-fd6c97d2a4e1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lazy-loading 'services' on Instance uuid 2b31e9e6-6a1c-44e8-bcdc-28130872f747 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:09:44.133586 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a674483-bd80-499a-a6ad-fd6c97d2a4e1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/os-volume_attachments/722ff35c-3826-4341-84ca-71bce5beeac8" status: 202 len: 0 microversion: 2.1 time: 0.345625 Sep 17 21:09:44.134099 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 294/601] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 17 21:09:43 2022] DELETE /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/os-volume_attachments/722ff35c-3826-4341-84ca-71bce5beeac8 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:09:44.780214 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d7ef8bc-e258-4f32-81b0-98e7fb90732c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:44.781053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d7ef8bc-e258-4f32-81b0-98e7fb90732c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:44.786832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c55cba54-1db6-4234-9c74-6ad7d981cb13 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:44.787275 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7ef8bc-e258-4f32-81b0-98e7fb90732c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:44.787578 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c55cba54-1db6-4234-9c74-6ad7d981cb13 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:44.787746 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7ef8bc-e258-4f32-81b0-98e7fb90732c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:44.788179 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7ef8bc-e258-4f32-81b0-98e7fb90732c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:44.788907 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7ef8bc-e258-4f32-81b0-98e7fb90732c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:44.790127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=54 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:44.790254 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7ef8bc-e258-4f32-81b0-98e7fb90732c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:44.790773 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7ef8bc-e258-4f32-81b0-98e7fb90732c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:44.796189 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c55cba54-1db6-4234-9c74-6ad7d981cb13 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:44.796691 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c55cba54-1db6-4234-9c74-6ad7d981cb13 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:44.797121 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c55cba54-1db6-4234-9c74-6ad7d981cb13 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:44.797810 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c55cba54-1db6-4234-9c74-6ad7d981cb13 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:44.798254 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c55cba54-1db6-4234-9c74-6ad7d981cb13 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:44.798679 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c55cba54-1db6-4234-9c74-6ad7d981cb13 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:44.986618 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5d7ef8bc-e258-4f32-81b0-98e7fb90732c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:44.989860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c55cba54-1db6-4234-9c74-6ad7d981cb13 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:44.995803 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d7ef8bc-e258-4f32-81b0-98e7fb90732c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.219373 Sep 17 21:09:44.996648 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 308/602] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:44 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:44.999338 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c55cba54-1db6-4234-9c74-6ad7d981cb13 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:45.000804 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c55cba54-1db6-4234-9c74-6ad7d981cb13 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:45.001974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c55cba54-1db6-4234-9c74-6ad7d981cb13 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.219724 Sep 17 21:09:45.002511 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 295/603] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:44 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:46.020812 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a808dc0-bd6b-4de1-aba2-efbf20b9fecc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:46.021425 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a808dc0-bd6b-4de1-aba2-efbf20b9fecc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:46.027076 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5fd88ada-ee08-4334-9b8e-98dce69a2e4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:46.027721 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5fd88ada-ee08-4334-9b8e-98dce69a2e4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:46.027836 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a808dc0-bd6b-4de1-aba2-efbf20b9fecc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.028316 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a808dc0-bd6b-4de1-aba2-efbf20b9fecc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.028773 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a808dc0-bd6b-4de1-aba2-efbf20b9fecc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.029476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a808dc0-bd6b-4de1-aba2-efbf20b9fecc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.029923 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a808dc0-bd6b-4de1-aba2-efbf20b9fecc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.030345 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a808dc0-bd6b-4de1-aba2-efbf20b9fecc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.034283 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5fd88ada-ee08-4334-9b8e-98dce69a2e4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.034771 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5fd88ada-ee08-4334-9b8e-98dce69a2e4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.035208 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5fd88ada-ee08-4334-9b8e-98dce69a2e4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.035903 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5fd88ada-ee08-4334-9b8e-98dce69a2e4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.036357 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5fd88ada-ee08-4334-9b8e-98dce69a2e4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.036812 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5fd88ada-ee08-4334-9b8e-98dce69a2e4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.225085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a808dc0-bd6b-4de1-aba2-efbf20b9fecc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:46.229725 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5fd88ada-ee08-4334-9b8e-98dce69a2e4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:46.234384 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a808dc0-bd6b-4de1-aba2-efbf20b9fecc tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.217458 Sep 17 21:09:46.234957 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 309/604] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:46 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:46.238180 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5fd88ada-ee08-4334-9b8e-98dce69a2e4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:46.240083 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5fd88ada-ee08-4334-9b8e-98dce69a2e4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:46.241309 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5fd88ada-ee08-4334-9b8e-98dce69a2e4e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.218244 Sep 17 21:09:46.241838 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 296/605] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:46 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:46.310386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e309c87a-d1e0-4c10-b716-f2c032f1e095 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:46.316302 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e309c87a-d1e0-4c10-b716-f2c032f1e095 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.316828 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e309c87a-d1e0-4c10-b716-f2c032f1e095 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.317270 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e309c87a-d1e0-4c10-b716-f2c032f1e095 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.330690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:46.340015 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e309c87a-d1e0-4c10-b716-f2c032f1e095 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Going to try to stop instance {{(pid=120587) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 21:09:46.381222 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e309c87a-d1e0-4c10-b716-f2c032f1e095 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "POST /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/action" status: 202 len: 0 microversion: 2.1 time: 0.074798 Sep 17 21:09:46.382004 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 310/606] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:09:46 2022] POST /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:09:46.390409 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e842f113-eda9-456f-8545-d5ac5b882b61 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:46.390944 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e842f113-eda9-456f-8545-d5ac5b882b61 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:46.396879 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e842f113-eda9-456f-8545-d5ac5b882b61 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.397359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e842f113-eda9-456f-8545-d5ac5b882b61 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.397788 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e842f113-eda9-456f-8545-d5ac5b882b61 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.398471 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e842f113-eda9-456f-8545-d5ac5b882b61 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.398955 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e842f113-eda9-456f-8545-d5ac5b882b61 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.399373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e842f113-eda9-456f-8545-d5ac5b882b61 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.534308 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e842f113-eda9-456f-8545-d5ac5b882b61 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:46.537696 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:46.542761 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e842f113-eda9-456f-8545-d5ac5b882b61 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.156633 Sep 17 21:09:46.543327 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 297/607] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:46 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:47.258480 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-151c8ce4-e5f5-4ae5-b542-e19558292aed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:47.259301 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-151c8ce4-e5f5-4ae5-b542-e19558292aed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:47.265984 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-151c8ce4-e5f5-4ae5-b542-e19558292aed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:47.266555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-151c8ce4-e5f5-4ae5-b542-e19558292aed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:47.266993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-151c8ce4-e5f5-4ae5-b542-e19558292aed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:47.267696 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-151c8ce4-e5f5-4ae5-b542-e19558292aed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:47.267805 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec33c1d2-1e02-470b-b898-9e6cd030fc08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:47.268208 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-151c8ce4-e5f5-4ae5-b542-e19558292aed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:47.268375 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec33c1d2-1e02-470b-b898-9e6cd030fc08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:47.268563 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-151c8ce4-e5f5-4ae5-b542-e19558292aed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:47.275141 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec33c1d2-1e02-470b-b898-9e6cd030fc08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:47.275621 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec33c1d2-1e02-470b-b898-9e6cd030fc08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:47.276049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec33c1d2-1e02-470b-b898-9e6cd030fc08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:47.276761 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec33c1d2-1e02-470b-b898-9e6cd030fc08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:47.277208 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec33c1d2-1e02-470b-b898-9e6cd030fc08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:47.277623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec33c1d2-1e02-470b-b898-9e6cd030fc08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:47.471250 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-151c8ce4-e5f5-4ae5-b542-e19558292aed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:47.475303 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ec33c1d2-1e02-470b-b898-9e6cd030fc08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:47.480561 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-151c8ce4-e5f5-4ae5-b542-e19558292aed tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1734 microversion: 2.1 time: 0.226720 Sep 17 21:09:47.481167 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 311/608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:47 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1734 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:47.485381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ec33c1d2-1e02-470b-b898-9e6cd030fc08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:47.487008 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ec33c1d2-1e02-470b-b898-9e6cd030fc08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:47.488222 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec33c1d2-1e02-470b-b898-9e6cd030fc08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.225094 Sep 17 21:09:47.488775 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 298/609] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:47 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:47.565500 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ef3fafcc-087b-43f1-8270-d538c3d5f70c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:47.566102 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ef3fafcc-087b-43f1-8270-d538c3d5f70c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:47.572532 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef3fafcc-087b-43f1-8270-d538c3d5f70c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:47.573234 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef3fafcc-087b-43f1-8270-d538c3d5f70c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:47.573667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef3fafcc-087b-43f1-8270-d538c3d5f70c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:47.574354 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef3fafcc-087b-43f1-8270-d538c3d5f70c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:47.574801 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef3fafcc-087b-43f1-8270-d538c3d5f70c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:47.575221 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef3fafcc-087b-43f1-8270-d538c3d5f70c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:47.708863 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ef3fafcc-087b-43f1-8270-d538c3d5f70c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:47.716918 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ef3fafcc-087b-43f1-8270-d538c3d5f70c tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.155191 Sep 17 21:09:47.717513 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 312/610] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:47 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:48.504474 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-877f0f5a-2c13-4cd2-be29-2679b73ba816 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:48.505115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-877f0f5a-2c13-4cd2-be29-2679b73ba816 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:48.512498 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-877f0f5a-2c13-4cd2-be29-2679b73ba816 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.513017 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-877f0f5a-2c13-4cd2-be29-2679b73ba816 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.513452 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-877f0f5a-2c13-4cd2-be29-2679b73ba816 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.514143 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-877f0f5a-2c13-4cd2-be29-2679b73ba816 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.514336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e97229ee-66e9-4a99-a4d1-ccfaa6c367fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:48.514733 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-877f0f5a-2c13-4cd2-be29-2679b73ba816 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.514974 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e97229ee-66e9-4a99-a4d1-ccfaa6c367fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:48.515080 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-877f0f5a-2c13-4cd2-be29-2679b73ba816 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.521291 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e97229ee-66e9-4a99-a4d1-ccfaa6c367fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.521770 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e97229ee-66e9-4a99-a4d1-ccfaa6c367fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.522202 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e97229ee-66e9-4a99-a4d1-ccfaa6c367fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.522921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e97229ee-66e9-4a99-a4d1-ccfaa6c367fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.523371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e97229ee-66e9-4a99-a4d1-ccfaa6c367fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.523793 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e97229ee-66e9-4a99-a4d1-ccfaa6c367fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.706638 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-877f0f5a-2c13-4cd2-be29-2679b73ba816 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:48.710402 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e97229ee-66e9-4a99-a4d1-ccfaa6c367fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:48.715592 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-877f0f5a-2c13-4cd2-be29-2679b73ba816 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1714 microversion: 2.1 time: 0.215046 Sep 17 21:09:48.716582 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 299/611] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:48 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1714 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:48.719581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e97229ee-66e9-4a99-a4d1-ccfaa6c367fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:48.721642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e97229ee-66e9-4a99-a4d1-ccfaa6c367fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:48.723010 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e97229ee-66e9-4a99-a4d1-ccfaa6c367fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.212444 Sep 17 21:09:48.726603 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 313/612] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:48 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:48.740048 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f89bc03-aaac-4ddf-977c-41ceef2abd03 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:48.741098 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0f89bc03-aaac-4ddf-977c-41ceef2abd03 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:48.747811 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f89bc03-aaac-4ddf-977c-41ceef2abd03 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.748375 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f89bc03-aaac-4ddf-977c-41ceef2abd03 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.748925 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f89bc03-aaac-4ddf-977c-41ceef2abd03 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.749692 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f89bc03-aaac-4ddf-977c-41ceef2abd03 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.750223 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f89bc03-aaac-4ddf-977c-41ceef2abd03 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.750645 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f89bc03-aaac-4ddf-977c-41ceef2abd03 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.778165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34fbb71d-f521-4dd7-bc35-fd625929681d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:48.778830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34fbb71d-f521-4dd7-bc35-fd625929681d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:48.784861 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fbb71d-f521-4dd7-bc35-fd625929681d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.785423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fbb71d-f521-4dd7-bc35-fd625929681d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.785931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fbb71d-f521-4dd7-bc35-fd625929681d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.786696 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fbb71d-f521-4dd7-bc35-fd625929681d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.787225 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fbb71d-f521-4dd7-bc35-fd625929681d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.787721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fbb71d-f521-4dd7-bc35-fd625929681d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.878954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0f89bc03-aaac-4ddf-977c-41ceef2abd03 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:48.887947 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0f89bc03-aaac-4ddf-977c-41ceef2abd03 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.151782 Sep 17 21:09:48.888715 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 300/613] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:48 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:48.914604 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-34fbb71d-f521-4dd7-bc35-fd625929681d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] HTTP exception thrown: Cannot 'detach_volume' instance 643a631e-9207-4669-a0bb-623a4a8ebf94 while it is in vm_state rescued Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34fbb71d-f521-4dd7-bc35-fd625929681d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Request method failure captured: Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-volume_attachments/66c9fa72-73b3-4c90-9fe9-1ba51ca9163c HTTP/1.1 Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZZwKfTj04T6UZy5whU5GnH06Qm2mjPMAvhRhYAf6YKOkKlLcdEUkYnhTcpRVF99d6zOw51Eu4MKu4qSCJA2DfrmeduSv2CPcOO2IOE6No0aJf0pyRwS9JPzSXJja0gkzZZ92NWtZdGv-AVZ4Zt9rvw5MPu-tY6pkTxKJ91Ococ8o8 Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: 1e42842c724f480f9cdd5ea75707b43f Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:09:48.916731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:09:48.918305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:09:48.918305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:09:48.918305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 1e42842c724f480f9cdd5ea75707b43f Sep 17 21:09:48.918305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:09:48.918305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-ServerRescueNegativeTestJSON-593011089-project Sep 17 21:09:48.918305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:09:48.918305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:09:48.918305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: a3dac44116784a9e963a69e4793bac4b Sep 17 21:09:48.918305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593011089-project Sep 17 21:09:48.918305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:09:48.918305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Cannot 'detach_volume' instance 643a631e-9207-4669-a0bb-623a4a8ebf94 while it is in vm_state rescued Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'server_id': '643a631e-9207-4669-a0bb-623a4a8ebf94', 'id': '66c9fa72-73b3-4c90-9fe9-1ba51ca9163c'} Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 643a631e-9207-4669-a0bb-623a4a8ebf94 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:09:48.919115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 643a631e-9207-4669-a0bb-623a4a8ebf94 while it is in vm_state rescued Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 643a631e-9207-4669-a0bb-623a4a8ebf94 while it is in vm_state rescued Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:09:48.920662 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34fbb71d-f521-4dd7-bc35-fd625929681d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Returning 409 to user: Cannot 'detach_volume' instance 643a631e-9207-4669-a0bb-623a4a8ebf94 while it is in vm_state rescued {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:09:48.926930 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34fbb71d-f521-4dd7-bc35-fd625929681d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "DELETE /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-volume_attachments/66c9fa72-73b3-4c90-9fe9-1ba51ca9163c" status: 409 len: 152 microversion: 2.1 time: 0.144099 Sep 17 21:09:48.926930 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 314/614] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 17 21:09:48 2022] DELETE /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-volume_attachments/66c9fa72-73b3-4c90-9fe9-1ba51ca9163c => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 17 21:09:48.928161 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f2000de9-82a6-4ff9-9b76-aad4128063ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:48.929722 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f2000de9-82a6-4ff9-9b76-aad4128063ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:48.936041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2000de9-82a6-4ff9-9b76-aad4128063ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.936449 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2000de9-82a6-4ff9-9b76-aad4128063ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.936963 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2000de9-82a6-4ff9-9b76-aad4128063ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.937660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2000de9-82a6-4ff9-9b76-aad4128063ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.938142 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2000de9-82a6-4ff9-9b76-aad4128063ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.938563 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2000de9-82a6-4ff9-9b76-aad4128063ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:49.002351 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f2000de9-82a6-4ff9-9b76-aad4128063ad tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "POST /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/action" status: 202 len: 0 microversion: 2.1 time: 0.078274 Sep 17 21:09:49.005514 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 301/615] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:09:48 2022] POST /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:09:49.011398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8580ef3-1044-4cf4-95bf-b025cf29bb4c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:49.012010 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8580ef3-1044-4cf4-95bf-b025cf29bb4c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:49.018718 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8580ef3-1044-4cf4-95bf-b025cf29bb4c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:49.019205 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8580ef3-1044-4cf4-95bf-b025cf29bb4c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:49.019637 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8580ef3-1044-4cf4-95bf-b025cf29bb4c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:49.020325 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8580ef3-1044-4cf4-95bf-b025cf29bb4c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:49.020817 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8580ef3-1044-4cf4-95bf-b025cf29bb4c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:49.021245 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8580ef3-1044-4cf4-95bf-b025cf29bb4c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:49.150148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8580ef3-1044-4cf4-95bf-b025cf29bb4c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:49.158147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8580ef3-1044-4cf4-95bf-b025cf29bb4c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1722 microversion: 2.1 time: 0.151047 Sep 17 21:09:49.158709 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 315/616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:49 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:49.750885 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14d5703a-dc5b-456c-8610-03699f72db6d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:49.751571 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14d5703a-dc5b-456c-8610-03699f72db6d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:49.757609 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14d5703a-dc5b-456c-8610-03699f72db6d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:49.758085 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14d5703a-dc5b-456c-8610-03699f72db6d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:49.758514 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14d5703a-dc5b-456c-8610-03699f72db6d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:49.759272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14d5703a-dc5b-456c-8610-03699f72db6d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:49.759719 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14d5703a-dc5b-456c-8610-03699f72db6d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:49.760135 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14d5703a-dc5b-456c-8610-03699f72db6d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:49.892083 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-14d5703a-dc5b-456c-8610-03699f72db6d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:49.901654 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-14d5703a-dc5b-456c-8610-03699f72db6d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:49.903099 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-14d5703a-dc5b-456c-8610-03699f72db6d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:49.904255 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14d5703a-dc5b-456c-8610-03699f72db6d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.158082 Sep 17 21:09:49.911663 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-18fa277d-de0e-473d-aadc-dab0fdd0de78 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:49.912405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-18fa277d-de0e-473d-aadc-dab0fdd0de78 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:49.917032 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 302/617] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:49 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:49.919765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18fa277d-de0e-473d-aadc-dab0fdd0de78 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:49.920314 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18fa277d-de0e-473d-aadc-dab0fdd0de78 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:49.920846 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18fa277d-de0e-473d-aadc-dab0fdd0de78 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:49.921608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18fa277d-de0e-473d-aadc-dab0fdd0de78 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:49.922130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18fa277d-de0e-473d-aadc-dab0fdd0de78 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:49.922637 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18fa277d-de0e-473d-aadc-dab0fdd0de78 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:50.121211 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-18fa277d-de0e-473d-aadc-dab0fdd0de78 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:50.128828 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-18fa277d-de0e-473d-aadc-dab0fdd0de78 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.221131 Sep 17 21:09:50.129400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 316/618] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:49 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:50.181401 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cfaa8e1c-b701-4bfb-860e-58da95f4ed4e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:50.182128 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cfaa8e1c-b701-4bfb-860e-58da95f4ed4e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:50.188091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaa8e1c-b701-4bfb-860e-58da95f4ed4e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:50.188652 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaa8e1c-b701-4bfb-860e-58da95f4ed4e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:50.189115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaa8e1c-b701-4bfb-860e-58da95f4ed4e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:50.189811 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaa8e1c-b701-4bfb-860e-58da95f4ed4e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:50.190261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaa8e1c-b701-4bfb-860e-58da95f4ed4e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:50.190687 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaa8e1c-b701-4bfb-860e-58da95f4ed4e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:50.422097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cfaa8e1c-b701-4bfb-860e-58da95f4ed4e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:50.430438 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cfaa8e1c-b701-4bfb-860e-58da95f4ed4e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1722 microversion: 2.1 time: 0.253139 Sep 17 21:09:50.431280 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 303/619] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:50 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:50.929918 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a77f994e-cafe-44da-834d-d0bc86558947 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:50.930987 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a77f994e-cafe-44da-834d-d0bc86558947 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:50.937857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77f994e-cafe-44da-834d-d0bc86558947 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:50.938344 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77f994e-cafe-44da-834d-d0bc86558947 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:50.938781 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77f994e-cafe-44da-834d-d0bc86558947 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:50.939491 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77f994e-cafe-44da-834d-d0bc86558947 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:50.939948 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77f994e-cafe-44da-834d-d0bc86558947 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:50.940375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77f994e-cafe-44da-834d-d0bc86558947 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:51.098379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a77f994e-cafe-44da-834d-d0bc86558947 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:51.114605 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a77f994e-cafe-44da-834d-d0bc86558947 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:51.117651 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a77f994e-cafe-44da-834d-d0bc86558947 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:51.120584 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a77f994e-cafe-44da-834d-d0bc86558947 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.194273 Sep 17 21:09:51.121621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 317/620] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:50 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:51.151301 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c98d231b-b4b7-4f62-8231-ef3159dee2a6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:51.151913 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c98d231b-b4b7-4f62-8231-ef3159dee2a6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:51.158175 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c98d231b-b4b7-4f62-8231-ef3159dee2a6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:51.158657 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c98d231b-b4b7-4f62-8231-ef3159dee2a6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:51.159085 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c98d231b-b4b7-4f62-8231-ef3159dee2a6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:51.159770 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c98d231b-b4b7-4f62-8231-ef3159dee2a6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:51.160218 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c98d231b-b4b7-4f62-8231-ef3159dee2a6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:51.160632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c98d231b-b4b7-4f62-8231-ef3159dee2a6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:51.293420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c98d231b-b4b7-4f62-8231-ef3159dee2a6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:51.301161 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c98d231b-b4b7-4f62-8231-ef3159dee2a6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.153708 Sep 17 21:09:51.301721 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 304/621] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:51 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:51.456227 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b5b8a9e-ad0b-4021-935c-86bd3660c73d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:51.456931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5b5b8a9e-ad0b-4021-935c-86bd3660c73d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:51.463453 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b5b8a9e-ad0b-4021-935c-86bd3660c73d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:51.463936 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b5b8a9e-ad0b-4021-935c-86bd3660c73d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:51.464372 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b5b8a9e-ad0b-4021-935c-86bd3660c73d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:51.465087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b5b8a9e-ad0b-4021-935c-86bd3660c73d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:51.465544 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b5b8a9e-ad0b-4021-935c-86bd3660c73d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:51.465969 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b5b8a9e-ad0b-4021-935c-86bd3660c73d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:51.594605 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b5b8a9e-ad0b-4021-935c-86bd3660c73d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:51.603234 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b5b8a9e-ad0b-4021-935c-86bd3660c73d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1722 microversion: 2.1 time: 0.150278 Sep 17 21:09:51.603795 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 318/622] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:51 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:52.146502 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4ee5685-dbf5-4036-8929-9cba7143dc60 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:52.147036 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e4ee5685-dbf5-4036-8929-9cba7143dc60 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:52.159479 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4ee5685-dbf5-4036-8929-9cba7143dc60 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:52.159479 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4ee5685-dbf5-4036-8929-9cba7143dc60 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:52.159479 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4ee5685-dbf5-4036-8929-9cba7143dc60 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:52.159479 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4ee5685-dbf5-4036-8929-9cba7143dc60 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:52.160286 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4ee5685-dbf5-4036-8929-9cba7143dc60 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:52.160286 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4ee5685-dbf5-4036-8929-9cba7143dc60 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:52.292221 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4ee5685-dbf5-4036-8929-9cba7143dc60 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:52.300657 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4ee5685-dbf5-4036-8929-9cba7143dc60 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:52.302111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4ee5685-dbf5-4036-8929-9cba7143dc60 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:52.303280 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4ee5685-dbf5-4036-8929-9cba7143dc60 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.160697 Sep 17 21:09:52.303851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 305/623] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:52 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:52.324879 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0db70524-1022-4f27-8529-5ae05dc2cd01 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:52.325481 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0db70524-1022-4f27-8529-5ae05dc2cd01 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:52.331838 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0db70524-1022-4f27-8529-5ae05dc2cd01 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:52.332303 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0db70524-1022-4f27-8529-5ae05dc2cd01 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:52.332765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0db70524-1022-4f27-8529-5ae05dc2cd01 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:52.333452 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0db70524-1022-4f27-8529-5ae05dc2cd01 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:52.333904 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0db70524-1022-4f27-8529-5ae05dc2cd01 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:52.334322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0db70524-1022-4f27-8529-5ae05dc2cd01 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:52.460493 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0db70524-1022-4f27-8529-5ae05dc2cd01 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:52.468981 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0db70524-1022-4f27-8529-5ae05dc2cd01 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.148105 Sep 17 21:09:52.469553 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 319/624] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:52 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:52.589668 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2362d528-3219-4ac1-ae31-a66f53428e73 req-895fb604-5ddc-4603-bd9d-47a865ffef52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785212fb-7493-49ce-b3f0-12b3742b3a88", "name": "network-vif-plugged", "status": "completed", "tag": "3a9a1b04-a0c4-4a66-a693-a268f50c530b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:52.599905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2362d528-3219-4ac1-ae31-a66f53428e73 req-895fb604-5ddc-4603-bd9d-47a865ffef52 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:52.600406 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2362d528-3219-4ac1-ae31-a66f53428e73 req-895fb604-5ddc-4603-bd9d-47a865ffef52 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:52.600868 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2362d528-3219-4ac1-ae31-a66f53428e73 req-895fb604-5ddc-4603-bd9d-47a865ffef52 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:52.612977 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2362d528-3219-4ac1-ae31-a66f53428e73 req-895fb604-5ddc-4603-bd9d-47a865ffef52 service nova] Creating event network-vif-plugged:3a9a1b04-a0c4-4a66-a693-a268f50c530b for instance 785212fb-7493-49ce-b3f0-12b3742b3a88 on hv-cinder-82651 Sep 17 21:09:52.617907 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2362d528-3219-4ac1-ae31-a66f53428e73 req-895fb604-5ddc-4603-bd9d-47a865ffef52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033000 Sep 17 21:09:52.618474 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 306/625] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:52.625832 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2773cfec-b033-4d84-a6d2-7f0a5cdf67da tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:52.626440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2773cfec-b033-4d84-a6d2-7f0a5cdf67da tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:52.632277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2773cfec-b033-4d84-a6d2-7f0a5cdf67da tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:52.632787 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2773cfec-b033-4d84-a6d2-7f0a5cdf67da tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:52.633222 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2773cfec-b033-4d84-a6d2-7f0a5cdf67da tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:52.634468 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2773cfec-b033-4d84-a6d2-7f0a5cdf67da tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:52.634921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2773cfec-b033-4d84-a6d2-7f0a5cdf67da tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:52.635342 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2773cfec-b033-4d84-a6d2-7f0a5cdf67da tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:52.763314 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2773cfec-b033-4d84-a6d2-7f0a5cdf67da tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:52.772829 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2773cfec-b033-4d84-a6d2-7f0a5cdf67da tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1722 microversion: 2.1 time: 0.150591 Sep 17 21:09:52.773406 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 320/626] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:52 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:53.329949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4ff0a515-4f54-48d9-a961-38a0109944e9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:53.330639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4ff0a515-4f54-48d9-a961-38a0109944e9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:53.338988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ff0a515-4f54-48d9-a961-38a0109944e9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:53.339481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ff0a515-4f54-48d9-a961-38a0109944e9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:53.339966 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ff0a515-4f54-48d9-a961-38a0109944e9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:53.340694 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ff0a515-4f54-48d9-a961-38a0109944e9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:53.341161 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ff0a515-4f54-48d9-a961-38a0109944e9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:53.341589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ff0a515-4f54-48d9-a961-38a0109944e9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:53.480549 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ff0a515-4f54-48d9-a961-38a0109944e9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:53.489379 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ff0a515-4f54-48d9-a961-38a0109944e9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:53.490835 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ff0a515-4f54-48d9-a961-38a0109944e9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:53.491995 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4ff0a515-4f54-48d9-a961-38a0109944e9 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.166267 Sep 17 21:09:53.492471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a149614b-fe88-41eb-a347-7a1e5048b301 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:53.493011 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 307/627] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:53 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:53.493386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a149614b-fe88-41eb-a347-7a1e5048b301 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:53.500044 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a149614b-fe88-41eb-a347-7a1e5048b301 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:53.500532 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a149614b-fe88-41eb-a347-7a1e5048b301 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:53.500999 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a149614b-fe88-41eb-a347-7a1e5048b301 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:53.501716 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a149614b-fe88-41eb-a347-7a1e5048b301 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:53.502176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a149614b-fe88-41eb-a347-7a1e5048b301 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:53.502605 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a149614b-fe88-41eb-a347-7a1e5048b301 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:53.629355 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a149614b-fe88-41eb-a347-7a1e5048b301 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:53.637561 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a149614b-fe88-41eb-a347-7a1e5048b301 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.148844 Sep 17 21:09:53.638116 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 321/628] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:53 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:53.796897 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d952585c-0b3c-4cf8-894f-a5cb09b0b4df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:53.797513 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d952585c-0b3c-4cf8-894f-a5cb09b0b4df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:53.803378 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d952585c-0b3c-4cf8-894f-a5cb09b0b4df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:53.804592 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d952585c-0b3c-4cf8-894f-a5cb09b0b4df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:53.805260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d952585c-0b3c-4cf8-894f-a5cb09b0b4df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:53.807204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d952585c-0b3c-4cf8-894f-a5cb09b0b4df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:53.807680 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d952585c-0b3c-4cf8-894f-a5cb09b0b4df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:53.808276 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d952585c-0b3c-4cf8-894f-a5cb09b0b4df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:53.997596 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d952585c-0b3c-4cf8-894f-a5cb09b0b4df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:54.006042 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d952585c-0b3c-4cf8-894f-a5cb09b0b4df tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1728 microversion: 2.1 time: 0.213104 Sep 17 21:09:54.006609 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 308/629] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:53 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:54.029283 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76f58f30-ff45-4b27-8f93-0ad3a93f4eee tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:54.029779 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76f58f30-ff45-4b27-8f93-0ad3a93f4eee tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:54.035746 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f58f30-ff45-4b27-8f93-0ad3a93f4eee tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:54.036234 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f58f30-ff45-4b27-8f93-0ad3a93f4eee tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:54.036690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f58f30-ff45-4b27-8f93-0ad3a93f4eee tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:54.037390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f58f30-ff45-4b27-8f93-0ad3a93f4eee tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:54.037858 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f58f30-ff45-4b27-8f93-0ad3a93f4eee tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:54.038287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f58f30-ff45-4b27-8f93-0ad3a93f4eee tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:54.114261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76f58f30-ff45-4b27-8f93-0ad3a93f4eee tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088771 Sep 17 21:09:54.114857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 322/630] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 17 21:09:54 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:54.517722 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d4adab8-3019-4136-8a17-b470d852647c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:54.518435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9d4adab8-3019-4136-8a17-b470d852647c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:54.525538 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d4adab8-3019-4136-8a17-b470d852647c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:54.526114 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d4adab8-3019-4136-8a17-b470d852647c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:54.526617 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d4adab8-3019-4136-8a17-b470d852647c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:54.527376 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d4adab8-3019-4136-8a17-b470d852647c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:54.527899 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d4adab8-3019-4136-8a17-b470d852647c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:54.528326 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d4adab8-3019-4136-8a17-b470d852647c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:54.660069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9d4adab8-3019-4136-8a17-b470d852647c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:54.661694 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2cf8c1f2-43a0-469b-8dcd-0e122fa19ca7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:54.662411 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2cf8c1f2-43a0-469b-8dcd-0e122fa19ca7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:54.669288 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf8c1f2-43a0-469b-8dcd-0e122fa19ca7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:54.669877 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf8c1f2-43a0-469b-8dcd-0e122fa19ca7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:54.670463 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9d4adab8-3019-4136-8a17-b470d852647c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:54.670803 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf8c1f2-43a0-469b-8dcd-0e122fa19ca7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:54.671712 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf8c1f2-43a0-469b-8dcd-0e122fa19ca7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:54.672242 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf8c1f2-43a0-469b-8dcd-0e122fa19ca7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:54.672621 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9d4adab8-3019-4136-8a17-b470d852647c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:54.672758 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf8c1f2-43a0-469b-8dcd-0e122fa19ca7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:54.673815 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9d4adab8-3019-4136-8a17-b470d852647c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.160103 Sep 17 21:09:54.674368 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 309/631] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:54 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:54.800202 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2cf8c1f2-43a0-469b-8dcd-0e122fa19ca7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:54.808821 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2cf8c1f2-43a0-469b-8dcd-0e122fa19ca7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.151771 Sep 17 21:09:54.809385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 323/632] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:54 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:54.999428 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d6d3db46-4fac-4ef9-a6db-94b902cbadce req-843547db-e56b-4e1f-a136-2ca822e4f4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643a631e-9207-4669-a0bb-623a4a8ebf94", "tag": "29f4bfa6-fb19-459c-af27-5bbb69ad95bd"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:55.011923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d6d3db46-4fac-4ef9-a6db-94b902cbadce req-843547db-e56b-4e1f-a136-2ca822e4f4c5 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:55.012478 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d6d3db46-4fac-4ef9-a6db-94b902cbadce req-843547db-e56b-4e1f-a136-2ca822e4f4c5 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:55.013010 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d6d3db46-4fac-4ef9-a6db-94b902cbadce req-843547db-e56b-4e1f-a136-2ca822e4f4c5 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:55.024020 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d6d3db46-4fac-4ef9-a6db-94b902cbadce req-843547db-e56b-4e1f-a136-2ca822e4f4c5 service nova] Creating event network-changed:29f4bfa6-fb19-459c-af27-5bbb69ad95bd for instance 643a631e-9207-4669-a0bb-623a4a8ebf94 on hv-cinder-82651 Sep 17 21:09:55.029264 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d6d3db46-4fac-4ef9-a6db-94b902cbadce req-843547db-e56b-4e1f-a136-2ca822e4f4c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033357 Sep 17 21:09:55.029866 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 310/633] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:55.700862 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23bc7a50-8ab9-49cd-bd4d-532f21214736 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:55.701314 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23bc7a50-8ab9-49cd-bd4d-532f21214736 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:55.712534 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23bc7a50-8ab9-49cd-bd4d-532f21214736 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:55.713256 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23bc7a50-8ab9-49cd-bd4d-532f21214736 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:55.713889 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23bc7a50-8ab9-49cd-bd4d-532f21214736 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:55.714595 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23bc7a50-8ab9-49cd-bd4d-532f21214736 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:55.715199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23bc7a50-8ab9-49cd-bd4d-532f21214736 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:55.715783 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23bc7a50-8ab9-49cd-bd4d-532f21214736 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:55.835414 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3919ed8b-7a59-4dcc-8f23-46b591dfc84d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:55.836127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3919ed8b-7a59-4dcc-8f23-46b591dfc84d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:55.843297 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3919ed8b-7a59-4dcc-8f23-46b591dfc84d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:55.843802 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3919ed8b-7a59-4dcc-8f23-46b591dfc84d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:55.844240 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3919ed8b-7a59-4dcc-8f23-46b591dfc84d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:55.845017 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3919ed8b-7a59-4dcc-8f23-46b591dfc84d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:55.845478 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3919ed8b-7a59-4dcc-8f23-46b591dfc84d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:55.846458 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3919ed8b-7a59-4dcc-8f23-46b591dfc84d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:55.889057 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-23bc7a50-8ab9-49cd-bd4d-532f21214736 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:55.900086 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-23bc7a50-8ab9-49cd-bd4d-532f21214736 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:55.901840 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-23bc7a50-8ab9-49cd-bd4d-532f21214736 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:55.903170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23bc7a50-8ab9-49cd-bd4d-532f21214736 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1808 microversion: 2.20 time: 0.207094 Sep 17 21:09:55.903751 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 324/634] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:55 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:55.998454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3919ed8b-7a59-4dcc-8f23-46b591dfc84d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:56.007456 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3919ed8b-7a59-4dcc-8f23-46b591dfc84d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.178798 Sep 17 21:09:56.008158 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 311/635] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:55 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:56.929226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5be7b4d5-e85a-46c3-8393-34bc410bcdd6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:56.929820 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5be7b4d5-e85a-46c3-8393-34bc410bcdd6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:56.936978 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5be7b4d5-e85a-46c3-8393-34bc410bcdd6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:56.937445 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5be7b4d5-e85a-46c3-8393-34bc410bcdd6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:56.937873 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5be7b4d5-e85a-46c3-8393-34bc410bcdd6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:56.938652 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5be7b4d5-e85a-46c3-8393-34bc410bcdd6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:56.939106 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5be7b4d5-e85a-46c3-8393-34bc410bcdd6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:56.939525 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5be7b4d5-e85a-46c3-8393-34bc410bcdd6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:57.031441 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4ab43fea-68ab-4507-b667-661b6cd282ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:57.032073 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4ab43fea-68ab-4507-b667-661b6cd282ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:57.038918 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ab43fea-68ab-4507-b667-661b6cd282ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:57.039412 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ab43fea-68ab-4507-b667-661b6cd282ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:57.040395 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ab43fea-68ab-4507-b667-661b6cd282ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:57.041328 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ab43fea-68ab-4507-b667-661b6cd282ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:57.041788 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ab43fea-68ab-4507-b667-661b6cd282ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:57.042226 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ab43fea-68ab-4507-b667-661b6cd282ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:57.074109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5be7b4d5-e85a-46c3-8393-34bc410bcdd6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:57.082807 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5be7b4d5-e85a-46c3-8393-34bc410bcdd6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:57.084255 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5be7b4d5-e85a-46c3-8393-34bc410bcdd6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:57.085453 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5be7b4d5-e85a-46c3-8393-34bc410bcdd6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1795 microversion: 2.20 time: 0.160080 Sep 17 21:09:57.086011 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 325/636] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:56 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:57.090319 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3249b8e3-cb34-4764-b49f-6110d5f773ac req-60446546-faf7-4058-832d-57f3f2e3a340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643a631e-9207-4669-a0bb-623a4a8ebf94", "tag": "29f4bfa6-fb19-459c-af27-5bbb69ad95bd"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:57.099665 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3249b8e3-cb34-4764-b49f-6110d5f773ac req-60446546-faf7-4058-832d-57f3f2e3a340 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:57.100147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3249b8e3-cb34-4764-b49f-6110d5f773ac req-60446546-faf7-4058-832d-57f3f2e3a340 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:57.100580 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3249b8e3-cb34-4764-b49f-6110d5f773ac req-60446546-faf7-4058-832d-57f3f2e3a340 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:57.112857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3249b8e3-cb34-4764-b49f-6110d5f773ac req-60446546-faf7-4058-832d-57f3f2e3a340 service nova] Creating event network-changed:29f4bfa6-fb19-459c-af27-5bbb69ad95bd for instance 643a631e-9207-4669-a0bb-623a4a8ebf94 on hv-cinder-82651 Sep 17 21:09:57.117863 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3249b8e3-cb34-4764-b49f-6110d5f773ac req-60446546-faf7-4058-832d-57f3f2e3a340 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030721 Sep 17 21:09:57.119079 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 326/637] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:57.174609 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ab43fea-68ab-4507-b667-661b6cd282ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:57.183478 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4ab43fea-68ab-4507-b667-661b6cd282ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.155745 Sep 17 21:09:57.183982 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 312/638] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:57 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:58.208544 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2d8e30d-73fb-44b5-a120-00f75ba807da tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:58.209284 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e2d8e30d-73fb-44b5-a120-00f75ba807da tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:58.215506 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d8e30d-73fb-44b5-a120-00f75ba807da tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:58.215993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d8e30d-73fb-44b5-a120-00f75ba807da tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:58.216431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d8e30d-73fb-44b5-a120-00f75ba807da tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:58.217146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d8e30d-73fb-44b5-a120-00f75ba807da tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:58.217602 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d8e30d-73fb-44b5-a120-00f75ba807da tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:58.218024 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d8e30d-73fb-44b5-a120-00f75ba807da tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:58.221189 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:58.350420 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e2d8e30d-73fb-44b5-a120-00f75ba807da tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:58.358255 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2d8e30d-73fb-44b5-a120-00f75ba807da tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.154390 Sep 17 21:09:58.358813 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 327/639] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:58 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:59.381784 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7877a65-2722-4dff-9b25-8419fd433513 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:59.382390 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e7877a65-2722-4dff-9b25-8419fd433513 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:59.389046 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7877a65-2722-4dff-9b25-8419fd433513 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:59.389527 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7877a65-2722-4dff-9b25-8419fd433513 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:59.389959 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7877a65-2722-4dff-9b25-8419fd433513 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:59.390677 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7877a65-2722-4dff-9b25-8419fd433513 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:59.391126 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7877a65-2722-4dff-9b25-8419fd433513 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:59.391542 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7877a65-2722-4dff-9b25-8419fd433513 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:59.517437 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e7877a65-2722-4dff-9b25-8419fd433513 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:59.525214 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e7877a65-2722-4dff-9b25-8419fd433513 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.147246 Sep 17 21:09:59.525785 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 313/640] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:59 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:00.548916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3fbefc8-f9b2-41b4-8b74-dfdf6af2b77a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:00.549519 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d3fbefc8-f9b2-41b4-8b74-dfdf6af2b77a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:00.556462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3fbefc8-f9b2-41b4-8b74-dfdf6af2b77a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:00.556961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3fbefc8-f9b2-41b4-8b74-dfdf6af2b77a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:00.557391 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3fbefc8-f9b2-41b4-8b74-dfdf6af2b77a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:00.558070 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3fbefc8-f9b2-41b4-8b74-dfdf6af2b77a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:00.558517 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3fbefc8-f9b2-41b4-8b74-dfdf6af2b77a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:00.558933 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3fbefc8-f9b2-41b4-8b74-dfdf6af2b77a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:00.683163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d3fbefc8-f9b2-41b4-8b74-dfdf6af2b77a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:00.690703 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3fbefc8-f9b2-41b4-8b74-dfdf6af2b77a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.145678 Sep 17 21:10:00.691262 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 328/641] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:00 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:01.714322 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c5640820-72c0-45a2-a9c8-f81aa42a6567 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:01.714927 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c5640820-72c0-45a2-a9c8-f81aa42a6567 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:01.720899 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5640820-72c0-45a2-a9c8-f81aa42a6567 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:01.721428 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5640820-72c0-45a2-a9c8-f81aa42a6567 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:01.721863 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5640820-72c0-45a2-a9c8-f81aa42a6567 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:01.722547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5640820-72c0-45a2-a9c8-f81aa42a6567 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:01.722995 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5640820-72c0-45a2-a9c8-f81aa42a6567 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:01.723414 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5640820-72c0-45a2-a9c8-f81aa42a6567 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:01.851849 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c5640820-72c0-45a2-a9c8-f81aa42a6567 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:01.856059 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:01.862282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c5640820-72c0-45a2-a9c8-f81aa42a6567 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.151770 Sep 17 21:10:01.862857 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 314/642] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:01 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:02.886276 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-627e142a-ed7e-4a24-aad1-085ea2bfa723 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:02.886872 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-627e142a-ed7e-4a24-aad1-085ea2bfa723 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:02.893559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-627e142a-ed7e-4a24-aad1-085ea2bfa723 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:02.894043 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-627e142a-ed7e-4a24-aad1-085ea2bfa723 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:02.894477 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-627e142a-ed7e-4a24-aad1-085ea2bfa723 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:02.895170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-627e142a-ed7e-4a24-aad1-085ea2bfa723 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:02.895624 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-627e142a-ed7e-4a24-aad1-085ea2bfa723 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:02.896050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-627e142a-ed7e-4a24-aad1-085ea2bfa723 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:03.025104 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-627e142a-ed7e-4a24-aad1-085ea2bfa723 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:03.033099 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-627e142a-ed7e-4a24-aad1-085ea2bfa723 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.151211 Sep 17 21:10:03.033688 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 329/643] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:02 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:04.058322 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3edee66b-4921-4f92-a119-e76e2448b845 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:04.058926 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3edee66b-4921-4f92-a119-e76e2448b845 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:04.066658 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3edee66b-4921-4f92-a119-e76e2448b845 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:04.067135 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3edee66b-4921-4f92-a119-e76e2448b845 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:04.067563 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3edee66b-4921-4f92-a119-e76e2448b845 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:04.068500 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3edee66b-4921-4f92-a119-e76e2448b845 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:04.068980 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3edee66b-4921-4f92-a119-e76e2448b845 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:04.069399 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3edee66b-4921-4f92-a119-e76e2448b845 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:04.225750 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3edee66b-4921-4f92-a119-e76e2448b845 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:04.233825 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3edee66b-4921-4f92-a119-e76e2448b845 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.180139 Sep 17 21:10:04.234389 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 315/644] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:04 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:04.858681 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d30441fc-2df1-4638-919c-2c3b854b255a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:04.859164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d30441fc-2df1-4638-919c-2c3b854b255a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:04.864992 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d30441fc-2df1-4638-919c-2c3b854b255a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:04.865465 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d30441fc-2df1-4638-919c-2c3b854b255a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:04.865893 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d30441fc-2df1-4638-919c-2c3b854b255a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:04.866575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d30441fc-2df1-4638-919c-2c3b854b255a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:04.867023 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d30441fc-2df1-4638-919c-2c3b854b255a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:04.867445 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d30441fc-2df1-4638-919c-2c3b854b255a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:04.891070 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d30441fc-2df1-4638-919c-2c3b854b255a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e/ips" status: 200 len: 149 microversion: 2.1 time: 0.092544 Sep 17 21:10:04.891637 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 330/645] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 17 21:10:04 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e/ips => generated 149 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:04.903441 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-44eb93a0-f401-41f9-83a7-d0d21cbcc375 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8db2f702-d972-4d65-aab0-8f20e347d8b7"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:04.905775 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-44eb93a0-f401-41f9-83a7-d0d21cbcc375 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:04.911550 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44eb93a0-f401-41f9-83a7-d0d21cbcc375 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:04.912026 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44eb93a0-f401-41f9-83a7-d0d21cbcc375 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:04.912454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44eb93a0-f401-41f9-83a7-d0d21cbcc375 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:04.913164 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44eb93a0-f401-41f9-83a7-d0d21cbcc375 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:04.913612 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44eb93a0-f401-41f9-83a7-d0d21cbcc375 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:04.914031 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44eb93a0-f401-41f9-83a7-d0d21cbcc375 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:04.991495 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-44eb93a0-f401-41f9-83a7-d0d21cbcc375 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Invalid volume: volume 8db2f702-d972-4d65-aab0-8f20e347d8b7 is already attached to instances: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-44eb93a0-f401-41f9-83a7-d0d21cbcc375 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e/os-volume_attachments HTTP/1.1 Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 74 Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:10:04.993354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:10:04.995616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:10:04.995616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:10:04.995616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:10:04.995616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:10:04.995616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:10:04.995616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:10:04.995616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:10:04.995616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:10:04.995616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:10:04.995616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Sep 17 21:10:04.995616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {"volumeAttachment": {"volumeId": "8db2f702-d972-4d65-aab0-8f20e347d8b7"}} Sep 17 21:10:04.995616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Invalid volume: volume 8db2f702-d972-4d65-aab0-8f20e347d8b7 is already attached to instances: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'server_id': '33fe9079-6aa4-43be-b5d0-8f5df95a890e', 'body': {'volumeAttachment': {'volumeId': '8db2f702-d972-4d65-aab0-8f20e347d8b7'}}} Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8db2f702-d972-4d65-aab0-8f20e347d8b7 is already attached to instances: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:04.996588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8db2f702-d972-4d65-aab0-8f20e347d8b7 is already attached to instances: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:04.998147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:04.999737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:04.999737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:04.999737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:04.999737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8db2f702-d972-4d65-aab0-8f20e347d8b7 is already attached to instances: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e Sep 17 21:10:04.999737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:04.999737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-44eb93a0-f401-41f9-83a7-d0d21cbcc375 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 400 to user: Invalid volume: volume 8db2f702-d972-4d65-aab0-8f20e347d8b7 is already attached to instances: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:04.999737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-44eb93a0-f401-41f9-83a7-d0d21cbcc375 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095940 Sep 17 21:10:04.999737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 316/646] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:10:04 2022] POST /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:10:05.007269 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76da8099-ad3a-4745-8c02-2623b5ea300e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:05.007880 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76da8099-ad3a-4745-8c02-2623b5ea300e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:05.014639 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76da8099-ad3a-4745-8c02-2623b5ea300e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:05.015123 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76da8099-ad3a-4745-8c02-2623b5ea300e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:05.015559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76da8099-ad3a-4745-8c02-2623b5ea300e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:05.016254 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76da8099-ad3a-4745-8c02-2623b5ea300e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:05.016780 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76da8099-ad3a-4745-8c02-2623b5ea300e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:05.017206 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76da8099-ad3a-4745-8c02-2623b5ea300e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:05.041293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76da8099-ad3a-4745-8c02-2623b5ea300e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:10:05.119405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76da8099-ad3a-4745-8c02-2623b5ea300e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 204 len: 0 microversion: 2.1 time: 0.115798 Sep 17 21:10:05.120105 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 331/647] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:10:05 2022] DELETE /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:10:05.128416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd1f40cf-2a8d-4903-a1b0-00706fe35b20 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:05.129032 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd1f40cf-2a8d-4903-a1b0-00706fe35b20 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:05.136896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd1f40cf-2a8d-4903-a1b0-00706fe35b20 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:05.137377 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd1f40cf-2a8d-4903-a1b0-00706fe35b20 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:05.137810 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd1f40cf-2a8d-4903-a1b0-00706fe35b20 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:05.138499 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd1f40cf-2a8d-4903-a1b0-00706fe35b20 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:05.138949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd1f40cf-2a8d-4903-a1b0-00706fe35b20 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:05.139367 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd1f40cf-2a8d-4903-a1b0-00706fe35b20 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:05.258046 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d648fc1-d71b-4e0f-80c3-80299add7645 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:05.259120 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0d648fc1-d71b-4e0f-80c3-80299add7645 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:05.265122 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d648fc1-d71b-4e0f-80c3-80299add7645 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:05.265608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d648fc1-d71b-4e0f-80c3-80299add7645 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:05.266050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d648fc1-d71b-4e0f-80c3-80299add7645 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:05.266199 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd1f40cf-2a8d-4903-a1b0-00706fe35b20 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:05.266743 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d648fc1-d71b-4e0f-80c3-80299add7645 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:05.267193 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d648fc1-d71b-4e0f-80c3-80299add7645 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:05.267608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d648fc1-d71b-4e0f-80c3-80299add7645 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:05.273883 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd1f40cf-2a8d-4903-a1b0-00706fe35b20 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1681 microversion: 2.1 time: 0.149283 Sep 17 21:10:05.274432 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 317/648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:05 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:05.396568 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d648fc1-d71b-4e0f-80c3-80299add7645 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:05.404195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d648fc1-d71b-4e0f-80c3-80299add7645 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.150378 Sep 17 21:10:05.404790 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 332/649] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:05 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:06.297064 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b5cd447-b7c1-481f-a069-3e7177f516eb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:06.297629 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b5cd447-b7c1-481f-a069-3e7177f516eb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:06.304249 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b5cd447-b7c1-481f-a069-3e7177f516eb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:06.304786 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b5cd447-b7c1-481f-a069-3e7177f516eb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:06.305230 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b5cd447-b7c1-481f-a069-3e7177f516eb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:06.305939 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b5cd447-b7c1-481f-a069-3e7177f516eb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:06.306545 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b5cd447-b7c1-481f-a069-3e7177f516eb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:06.307168 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b5cd447-b7c1-481f-a069-3e7177f516eb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:06.427477 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5dd96329-735e-451a-be83-391dd29f2657 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:06.428103 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5dd96329-735e-451a-be83-391dd29f2657 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:06.434931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5dd96329-735e-451a-be83-391dd29f2657 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:06.435521 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5dd96329-735e-451a-be83-391dd29f2657 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:06.435961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5dd96329-735e-451a-be83-391dd29f2657 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:06.436652 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5dd96329-735e-451a-be83-391dd29f2657 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:06.437207 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5dd96329-735e-451a-be83-391dd29f2657 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:06.437308 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b5cd447-b7c1-481f-a069-3e7177f516eb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:06.437627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5dd96329-735e-451a-be83-391dd29f2657 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:06.445020 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b5cd447-b7c1-481f-a069-3e7177f516eb tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1681 microversion: 2.1 time: 0.151908 Sep 17 21:10:06.445572 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 318/650] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:06 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:06.564293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5dd96329-735e-451a-be83-391dd29f2657 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:06.573253 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5dd96329-735e-451a-be83-391dd29f2657 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1677 microversion: 2.1 time: 0.149658 Sep 17 21:10:06.573810 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 333/651] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:06 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:07.469634 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5977eb33-75f7-4c6d-ab81-a35e5e051796 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:07.470254 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5977eb33-75f7-4c6d-ab81-a35e5e051796 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:07.476342 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5977eb33-75f7-4c6d-ab81-a35e5e051796 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.476853 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5977eb33-75f7-4c6d-ab81-a35e5e051796 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.477294 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5977eb33-75f7-4c6d-ab81-a35e5e051796 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.477989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5977eb33-75f7-4c6d-ab81-a35e5e051796 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.478446 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5977eb33-75f7-4c6d-ab81-a35e5e051796 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.478950 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5977eb33-75f7-4c6d-ab81-a35e5e051796 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.549890 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5977eb33-75f7-4c6d-ab81-a35e5e051796 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:07.557855 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5977eb33-75f7-4c6d-ab81-a35e5e051796 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1613 microversion: 2.1 time: 0.092125 Sep 17 21:10:07.558412 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 319/652] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:07 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:07.595638 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa942468-4f51-4b29-b4b4-f42aff4ff2dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:07.596244 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fa942468-4f51-4b29-b4b4-f42aff4ff2dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:07.602688 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa942468-4f51-4b29-b4b4-f42aff4ff2dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.603377 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa942468-4f51-4b29-b4b4-f42aff4ff2dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.603822 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa942468-4f51-4b29-b4b4-f42aff4ff2dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.604511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa942468-4f51-4b29-b4b4-f42aff4ff2dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.604990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa942468-4f51-4b29-b4b4-f42aff4ff2dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.605408 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa942468-4f51-4b29-b4b4-f42aff4ff2dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.813149 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fa942468-4f51-4b29-b4b4-f42aff4ff2dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:07.821387 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa942468-4f51-4b29-b4b4-f42aff4ff2dc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1654 microversion: 2.1 time: 0.229557 Sep 17 21:10:07.822749 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 334/653] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:07 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1654 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:07.845068 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c2ab15f9-620c-4dfb-8aef-196248f54c3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:07.851336 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2ab15f9-620c-4dfb-8aef-196248f54c3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.851820 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2ab15f9-620c-4dfb-8aef-196248f54c3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.852254 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2ab15f9-620c-4dfb-8aef-196248f54c3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.875041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c2ab15f9-620c-4dfb-8aef-196248f54c3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Going to try to start instance {{(pid=120588) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 17 21:10:07.927242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c2ab15f9-620c-4dfb-8aef-196248f54c3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "POST /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/action" status: 202 len: 0 microversion: 2.1 time: 0.085690 Sep 17 21:10:07.929252 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 320/654] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:10:07 2022] POST /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:10:07.937489 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73ca6887-3a82-4454-974a-8266185805fa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:07.938652 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-73ca6887-3a82-4454-974a-8266185805fa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:07.953188 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73ca6887-3a82-4454-974a-8266185805fa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.954079 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73ca6887-3a82-4454-974a-8266185805fa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.954831 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73ca6887-3a82-4454-974a-8266185805fa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.956107 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73ca6887-3a82-4454-974a-8266185805fa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.957076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73ca6887-3a82-4454-974a-8266185805fa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.957681 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73ca6887-3a82-4454-974a-8266185805fa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:08.011105 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d8663c2f-fbc5-4802-b3a1-b0d095a6e605 req-084b029e-af0f-42d7-9f3d-44a990ca1840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33fe9079-6aa4-43be-b5d0-8f5df95a890e", "name": "network-vif-deleted", "tag": "8194fc95-84a0-4a89-b5d3-4e1533b9ce62"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:08.038472 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d8663c2f-fbc5-4802-b3a1-b0d095a6e605 req-084b029e-af0f-42d7-9f3d-44a990ca1840 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:08.039368 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d8663c2f-fbc5-4802-b3a1-b0d095a6e605 req-084b029e-af0f-42d7-9f3d-44a990ca1840 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:08.039972 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d8663c2f-fbc5-4802-b3a1-b0d095a6e605 req-084b029e-af0f-42d7-9f3d-44a990ca1840 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:08.066995 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d8663c2f-fbc5-4802-b3a1-b0d095a6e605 req-084b029e-af0f-42d7-9f3d-44a990ca1840 service nova] Creating event network-vif-deleted:8194fc95-84a0-4a89-b5d3-4e1533b9ce62 for instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e on hv-cinder-82651 Sep 17 21:10:08.076639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d8663c2f-fbc5-4802-b3a1-b0d095a6e605 req-084b029e-af0f-42d7-9f3d-44a990ca1840 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125385 Sep 17 21:10:08.080119 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 321/655] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:08.224356 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-73ca6887-3a82-4454-974a-8266185805fa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:08.240645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-73ca6887-3a82-4454-974a-8266185805fa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1663 microversion: 2.1 time: 0.307102 Sep 17 21:10:08.241523 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 335/656] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:07 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1663 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:08.582975 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:08.584364 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:08.591741 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:08.592229 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:08.592659 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:08.593370 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:08.593851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:08.594266 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:08.627669 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:08.628149 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:08.628582 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:08.629047 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lazy-loading 'fault' on Instance uuid 33fe9079-6aa4-43be-b5d0-8f5df95a890e {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:10:08.698724 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:08.729977 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-29088153-5d8c-423a-ac89-87e3d885e5d7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 200 len: 1331 microversion: 2.1 time: 0.150940 Sep 17 21:10:08.745438 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 322/657] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:08 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 1331 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:09.263793 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d26a4ab0-7e22-405a-99df-6f32fb67e94a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:09.264410 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d26a4ab0-7e22-405a-99df-6f32fb67e94a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:09.271142 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d26a4ab0-7e22-405a-99df-6f32fb67e94a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.271626 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d26a4ab0-7e22-405a-99df-6f32fb67e94a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.272058 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d26a4ab0-7e22-405a-99df-6f32fb67e94a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.272785 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d26a4ab0-7e22-405a-99df-6f32fb67e94a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.273242 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d26a4ab0-7e22-405a-99df-6f32fb67e94a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.273663 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d26a4ab0-7e22-405a-99df-6f32fb67e94a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.410780 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d26a4ab0-7e22-405a-99df-6f32fb67e94a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:09.421973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d26a4ab0-7e22-405a-99df-6f32fb67e94a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1663 microversion: 2.1 time: 0.159674 Sep 17 21:10:09.421973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 336/658] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:09 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:09.755527 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b3ab749-f834-4137-9c3a-385bbf7e07a0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:09.756159 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b3ab749-f834-4137-9c3a-385bbf7e07a0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:09.763038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b3ab749-f834-4137-9c3a-385bbf7e07a0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.763513 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b3ab749-f834-4137-9c3a-385bbf7e07a0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.763940 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b3ab749-f834-4137-9c3a-385bbf7e07a0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.764620 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b3ab749-f834-4137-9c3a-385bbf7e07a0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.765095 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b3ab749-f834-4137-9c3a-385bbf7e07a0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.765511 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b3ab749-f834-4137-9c3a-385bbf7e07a0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.779483 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-3b3ab749-f834-4137-9c3a-385bbf7e07a0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b3ab749-f834-4137-9c3a-385bbf7e07a0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e HTTP/1.1 Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:10:09.781117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:10:09.782686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:10:09.782686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:10:09.782686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:10:09.782686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:10:09.782686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:10:09.782686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:10:09.782686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:10:09.782686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:10:09.782686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:10:09.782686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:10:09.782686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:10:09.782686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '33fe9079-6aa4-43be-b5d0-8f5df95a890e'} Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:09.783553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:10:09.785004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:09.786296 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b3ab749-f834-4137-9c3a-385bbf7e07a0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 404 to user: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:09.786296 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b3ab749-f834-4137-9c3a-385bbf7e07a0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 404 len: 111 microversion: 2.1 time: 0.030923 Sep 17 21:10:09.786296 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 323/659] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:09 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:10:09.791354 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4007978c-32b2-49b1-919c-2d82899dad0d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '.version_select at 0x7f9ba761d4c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:09.810302 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4007978c-32b2-49b1-919c-2d82899dad0d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-538995622" status: 202 len: 0 microversion: 2.1 time: 0.022704 Sep 17 21:10:09.810845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 337/660] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Sep 17 21:10:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-538995622 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:10:10.445793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0641b90f-34d8-4c82-a51c-7879d8fd05ee tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:10.446931 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0641b90f-34d8-4c82-a51c-7879d8fd05ee tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:10.450613 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da488800-274b-4db9-9fb2-30d70310a768 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:10.451134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da488800-274b-4db9-9fb2-30d70310a768 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:10.453018 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0641b90f-34d8-4c82-a51c-7879d8fd05ee tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:10.453498 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0641b90f-34d8-4c82-a51c-7879d8fd05ee tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:10.453931 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0641b90f-34d8-4c82-a51c-7879d8fd05ee tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:10.454623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0641b90f-34d8-4c82-a51c-7879d8fd05ee tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:10.455077 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0641b90f-34d8-4c82-a51c-7879d8fd05ee tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:10.455501 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0641b90f-34d8-4c82-a51c-7879d8fd05ee tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:10.457483 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da488800-274b-4db9-9fb2-30d70310a768 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:10.457942 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da488800-274b-4db9-9fb2-30d70310a768 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:10.458369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da488800-274b-4db9-9fb2-30d70310a768 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:10.459076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da488800-274b-4db9-9fb2-30d70310a768 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:10.459503 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da488800-274b-4db9-9fb2-30d70310a768 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:10.459927 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da488800-274b-4db9-9fb2-30d70310a768 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:10.543046 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-da488800-274b-4db9-9fb2-30d70310a768 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lazy-loading 'services' on Instance uuid b38b7550-7fb1-4104-b38d-6ae86dbe3a1e {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:10:10.588789 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0641b90f-34d8-4c82-a51c-7879d8fd05ee tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:10.596577 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0641b90f-34d8-4c82-a51c-7879d8fd05ee tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1667 microversion: 2.1 time: 0.154840 Sep 17 21:10:10.597169 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 324/661] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:10 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:10.656555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da488800-274b-4db9-9fb2-30d70310a768 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e/os-volume_attachments/8db2f702-d972-4d65-aab0-8f20e347d8b7" status: 202 len: 0 microversion: 2.1 time: 0.210756 Sep 17 21:10:10.657198 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 338/662] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 17 21:10:10 2022] DELETE /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e/os-volume_attachments/8db2f702-d972-4d65-aab0-8f20e347d8b7 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:10:10.666129 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c5164894-7fca-4423-8f6a-6b23fd884028 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:10.668460 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c5164894-7fca-4423-8f6a-6b23fd884028 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:10.674512 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5164894-7fca-4423-8f6a-6b23fd884028 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:10.674997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5164894-7fca-4423-8f6a-6b23fd884028 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:10.675433 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5164894-7fca-4423-8f6a-6b23fd884028 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:10.676125 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5164894-7fca-4423-8f6a-6b23fd884028 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:10.676619 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5164894-7fca-4423-8f6a-6b23fd884028 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:10.677287 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5164894-7fca-4423-8f6a-6b23fd884028 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:10.708457 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c5164894-7fca-4423-8f6a-6b23fd884028 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046828 Sep 17 21:10:10.709025 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 325/663] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:10:10 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:11.721489 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0f349d41-a8d3-484c-a7bf-fbd49dce484f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:11.723841 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0f349d41-a8d3-484c-a7bf-fbd49dce484f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:11.730674 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f349d41-a8d3-484c-a7bf-fbd49dce484f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.731153 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f349d41-a8d3-484c-a7bf-fbd49dce484f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.731581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f349d41-a8d3-484c-a7bf-fbd49dce484f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.732264 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f349d41-a8d3-484c-a7bf-fbd49dce484f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.732741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f349d41-a8d3-484c-a7bf-fbd49dce484f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.733162 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f349d41-a8d3-484c-a7bf-fbd49dce484f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.764445 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0f349d41-a8d3-484c-a7bf-fbd49dce484f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047306 Sep 17 21:10:11.765022 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 339/664] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:10:11 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:10:11.826996 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6858ba22-0ee5-46b3-9384-93b89166964a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:11.827490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6858ba22-0ee5-46b3-9384-93b89166964a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:11.833820 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6858ba22-0ee5-46b3-9384-93b89166964a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.834302 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6858ba22-0ee5-46b3-9384-93b89166964a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.834734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6858ba22-0ee5-46b3-9384-93b89166964a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.835417 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6858ba22-0ee5-46b3-9384-93b89166964a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.835871 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6858ba22-0ee5-46b3-9384-93b89166964a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.836292 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6858ba22-0ee5-46b3-9384-93b89166964a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.860771 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6858ba22-0ee5-46b3-9384-93b89166964a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:10:11.941886 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6858ba22-0ee5-46b3-9384-93b89166964a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 204 len: 0 microversion: 2.1 time: 0.118361 Sep 17 21:10:11.942461 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 326/665] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:10:11 2022] DELETE /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:10:11.951613 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd64942d-ac09-4679-9888-6472a7359217 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:11.952253 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cd64942d-ac09-4679-9888-6472a7359217 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:11.958186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd64942d-ac09-4679-9888-6472a7359217 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.958580 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd64942d-ac09-4679-9888-6472a7359217 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.959017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd64942d-ac09-4679-9888-6472a7359217 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.959698 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd64942d-ac09-4679-9888-6472a7359217 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.960148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd64942d-ac09-4679-9888-6472a7359217 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.960565 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd64942d-ac09-4679-9888-6472a7359217 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:12.087471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cd64942d-ac09-4679-9888-6472a7359217 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:12.095111 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd64942d-ac09-4679-9888-6472a7359217 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1678 microversion: 2.1 time: 0.147330 Sep 17 21:10:12.095675 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 340/666] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:11 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:13.119309 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-130fb9ae-be0c-4081-b4f4-a60b45effeac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:13.120033 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-130fb9ae-be0c-4081-b4f4-a60b45effeac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:13.126365 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-130fb9ae-be0c-4081-b4f4-a60b45effeac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.126844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-130fb9ae-be0c-4081-b4f4-a60b45effeac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.127275 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-130fb9ae-be0c-4081-b4f4-a60b45effeac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.127961 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-130fb9ae-be0c-4081-b4f4-a60b45effeac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.128411 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-130fb9ae-be0c-4081-b4f4-a60b45effeac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.128865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-130fb9ae-be0c-4081-b4f4-a60b45effeac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.258074 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-130fb9ae-be0c-4081-b4f4-a60b45effeac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:13.265665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-130fb9ae-be0c-4081-b4f4-a60b45effeac tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1678 microversion: 2.1 time: 0.150574 Sep 17 21:10:13.266218 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 327/667] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:13 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:14.290765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-74066266-e8a2-4a75-bc4b-c0ee8236e05d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:14.291375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-74066266-e8a2-4a75-bc4b-c0ee8236e05d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:14.293979 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:14.299206 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74066266-e8a2-4a75-bc4b-c0ee8236e05d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:14.299692 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74066266-e8a2-4a75-bc4b-c0ee8236e05d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:14.300133 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74066266-e8a2-4a75-bc4b-c0ee8236e05d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:14.300872 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74066266-e8a2-4a75-bc4b-c0ee8236e05d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:14.301435 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74066266-e8a2-4a75-bc4b-c0ee8236e05d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:14.301866 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74066266-e8a2-4a75-bc4b-c0ee8236e05d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:14.542388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-74066266-e8a2-4a75-bc4b-c0ee8236e05d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:14.550060 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-74066266-e8a2-4a75-bc4b-c0ee8236e05d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1678 microversion: 2.1 time: 0.263625 Sep 17 21:10:14.550853 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 341/668] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:14 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1678 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:15.184506 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-21c5e082-01a3-464d-9bf9-a9c64ffbe2bf req-e8eecaf3-0a12-4ec9-b346-cf331ca338ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38b7550-7fb1-4104-b38d-6ae86dbe3a1e", "name": "network-vif-deleted", "tag": "9475a995-1a52-4771-b571-1e84b3dbc2f6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:15.190920 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:15.197816 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-21c5e082-01a3-464d-9bf9-a9c64ffbe2bf req-e8eecaf3-0a12-4ec9-b346-cf331ca338ac service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:15.198604 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-21c5e082-01a3-464d-9bf9-a9c64ffbe2bf req-e8eecaf3-0a12-4ec9-b346-cf331ca338ac service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:15.199168 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-21c5e082-01a3-464d-9bf9-a9c64ffbe2bf req-e8eecaf3-0a12-4ec9-b346-cf331ca338ac service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:15.211286 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-21c5e082-01a3-464d-9bf9-a9c64ffbe2bf req-e8eecaf3-0a12-4ec9-b346-cf331ca338ac service nova] Creating event network-vif-deleted:9475a995-1a52-4771-b571-1e84b3dbc2f6 for instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e on hv-cinder-82651 Sep 17 21:10:15.217245 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-21c5e082-01a3-464d-9bf9-a9c64ffbe2bf req-e8eecaf3-0a12-4ec9-b346-cf331ca338ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036341 Sep 17 21:10:15.217983 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 328/669] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:15.574121 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:15.574742 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:15.581403 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:15.581889 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:15.582327 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:15.583059 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:15.583524 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:15.584038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:15.615805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:15.616284 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:15.616807 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:15.617250 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lazy-loading 'fault' on Instance uuid b38b7550-7fb1-4104-b38d-6ae86dbe3a1e {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:10:15.620071 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:15.658986 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:15.667191 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bfde265e-f283-4629-bf66-cd80eca26905 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 200 len: 1330 microversion: 2.1 time: 0.097083 Sep 17 21:10:15.667870 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 342/670] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:15 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:16.691673 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27875762-a413-42d2-b3b3-21aed8b7a092 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:16.692364 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-27875762-a413-42d2-b3b3-21aed8b7a092 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:16.699442 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27875762-a413-42d2-b3b3-21aed8b7a092 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:16.699923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27875762-a413-42d2-b3b3-21aed8b7a092 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:16.700359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27875762-a413-42d2-b3b3-21aed8b7a092 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:16.701086 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27875762-a413-42d2-b3b3-21aed8b7a092 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:16.701536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27875762-a413-42d2-b3b3-21aed8b7a092 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:16.701955 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27875762-a413-42d2-b3b3-21aed8b7a092 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:16.717349 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-27875762-a413-42d2-b3b3-21aed8b7a092 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27875762-a413-42d2-b3b3-21aed8b7a092 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e HTTP/1.1 Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:10:16.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:10:16.720420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:10:16.720420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:10:16.720420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:10:16.720420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:10:16.720420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:10:16.720420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:10:16.720420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:10:16.720420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:10:16.720420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:10:16.720420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:10:16.720420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:10:16.720420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': 'b38b7550-7fb1-4104-b38d-6ae86dbe3a1e'} Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:16.721281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:10:16.722862 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:16.724285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27875762-a413-42d2-b3b3-21aed8b7a092 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 404 to user: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:16.724285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27875762-a413-42d2-b3b3-21aed8b7a092 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 404 len: 111 microversion: 2.1 time: 0.033317 Sep 17 21:10:16.724285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 329/671] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:16 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:10:16.729174 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a355609-e362-4fde-8587-536b15b7c335 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '.version_select at 0x7f9ba74a2280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:16.747099 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a355609-e362-4fde-8587-536b15b7c335 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929499607" status: 202 len: 0 microversion: 2.1 time: 0.021788 Sep 17 21:10:16.747649 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 343/672] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 17 21:10:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929499607 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:10:17.369121 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92a81c07-2e79-43db-9f2b-09c9b7c8ed57 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: .version_select at 0x7f9baad9ee50>, body: {"keypair": {"name": "tempest-keypair-1013666660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJe5gQqFlE+/VlXdtio+1pcI9zvC1BnJk0F5jHn0ULApLGuOF20NYr/+aWLeCSSd6y/8dWNNjYyDJawt4gZY4apq3r8i3zkKONz0Bm3t8n0z+Kr6ng6mwDurfrTQ1xAHTg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:17.384584 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-92a81c07-2e79-43db-9f2b-09c9b7c8ed57 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for project d9689fd1a04647cf91a73680e4b677d1. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:10:17.388358 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-92a81c07-2e79-43db-9f2b-09c9b7c8ed57 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for user 1e3b1e0f4888400b89c47b3e44443228 and project d9689fd1a04647cf91a73680e4b677d1. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:10:17.410003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92a81c07-2e79-43db-9f2b-09c9b7c8ed57 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044849 Sep 17 21:10:17.410581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 330/673] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 17 21:10:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:18.600369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-808163270", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2c320a7-411d-4280-a740-e3d2f3da6961"}], "security_groups": [{"name": "tempest-securitygroup--1652384372"}], "key_name": "tempest-keypair-1013666660", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:18.702897 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] validate_networks() for [('b2c320a7-411d-4280-a740-e3d2f3da6961', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:10:19.114300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:10:19.114721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:10:19.115190 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:10:19.115628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:10:19.116033 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:10:19.125232 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.125709 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.126137 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.126850 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.127299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.127715 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.144696 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for project d9689fd1a04647cf91a73680e4b677d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:10:19.148722 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for user 1e3b1e0f4888400b89c47b3e44443228 and project d9689fd1a04647cf91a73680e4b677d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:10:19.159393 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:10:19.161759 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:10:19.210170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3c0faed5-15ed-40f6-9a68-cee5d8c8f4b3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614606 Sep 17 21:10:19.210855 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 344/674] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:10:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:10:19.223149 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a153cb46-c644-4b35-bddc-b51ec70ff946 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:19.223764 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a153cb46-c644-4b35-bddc-b51ec70ff946 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:19.281884 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a153cb46-c644-4b35-bddc-b51ec70ff946 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:19.289539 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a153cb46-c644-4b35-bddc-b51ec70ff946 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1241 microversion: 2.1 time: 0.071027 Sep 17 21:10:19.290115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 331/675] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:19 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:20.311746 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75709438-3268-42d8-be27-25696dab9d5d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:20.312379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75709438-3268-42d8-be27-25696dab9d5d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:20.319501 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75709438-3268-42d8-be27-25696dab9d5d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:20.319997 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75709438-3268-42d8-be27-25696dab9d5d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:20.320435 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75709438-3268-42d8-be27-25696dab9d5d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:20.321675 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75709438-3268-42d8-be27-25696dab9d5d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:20.322131 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75709438-3268-42d8-be27-25696dab9d5d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:20.322554 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75709438-3268-42d8-be27-25696dab9d5d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:20.383425 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-75709438-3268-42d8-be27-25696dab9d5d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:20.393124 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75709438-3268-42d8-be27-25696dab9d5d tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1293 microversion: 2.1 time: 0.085077 Sep 17 21:10:20.393940 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 345/676] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:20 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:21.417677 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-51ed4aaa-d6e1-48c1-b7fb-e72352d10154 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:21.418832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-51ed4aaa-d6e1-48c1-b7fb-e72352d10154 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:21.425104 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51ed4aaa-d6e1-48c1-b7fb-e72352d10154 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:21.425598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51ed4aaa-d6e1-48c1-b7fb-e72352d10154 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:21.426040 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51ed4aaa-d6e1-48c1-b7fb-e72352d10154 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:21.426751 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51ed4aaa-d6e1-48c1-b7fb-e72352d10154 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:21.427208 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51ed4aaa-d6e1-48c1-b7fb-e72352d10154 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:21.427784 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51ed4aaa-d6e1-48c1-b7fb-e72352d10154 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:21.674201 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-51ed4aaa-d6e1-48c1-b7fb-e72352d10154 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:21.682402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-51ed4aaa-d6e1-48c1-b7fb-e72352d10154 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1367 microversion: 2.1 time: 0.269897 Sep 17 21:10:21.683052 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 332/677] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:21 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:22.040413 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d67d606a-db5b-4ea9-8f9f-74ffc7c51cda req-c9c55c4c-a83e-4378-ba4b-aeab2d5b9fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f1be29-b81c-4f72-99e3-979c1aab0af2", "tag": "0d83c88e-4130-4aea-9402-15f46ff88289"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:22.051918 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d67d606a-db5b-4ea9-8f9f-74ffc7c51cda req-c9c55c4c-a83e-4378-ba4b-aeab2d5b9fcc service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:22.052400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d67d606a-db5b-4ea9-8f9f-74ffc7c51cda req-c9c55c4c-a83e-4378-ba4b-aeab2d5b9fcc service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:22.053172 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d67d606a-db5b-4ea9-8f9f-74ffc7c51cda req-c9c55c4c-a83e-4378-ba4b-aeab2d5b9fcc service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:22.066096 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d67d606a-db5b-4ea9-8f9f-74ffc7c51cda req-c9c55c4c-a83e-4378-ba4b-aeab2d5b9fcc service nova] Creating event network-changed:0d83c88e-4130-4aea-9402-15f46ff88289 for instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 on hv-cinder-82651 Sep 17 21:10:22.071960 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d67d606a-db5b-4ea9-8f9f-74ffc7c51cda req-c9c55c4c-a83e-4378-ba4b-aeab2d5b9fcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035638 Sep 17 21:10:22.073206 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 346/678] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:22.706447 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67322db0-7cc0-45f9-bf89-f3c2dca8176c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:22.707056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-67322db0-7cc0-45f9-bf89-f3c2dca8176c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:22.714123 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67322db0-7cc0-45f9-bf89-f3c2dca8176c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:22.714602 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67322db0-7cc0-45f9-bf89-f3c2dca8176c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:22.715038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67322db0-7cc0-45f9-bf89-f3c2dca8176c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:22.715725 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67322db0-7cc0-45f9-bf89-f3c2dca8176c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:22.716177 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67322db0-7cc0-45f9-bf89-f3c2dca8176c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:22.716602 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67322db0-7cc0-45f9-bf89-f3c2dca8176c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:22.720569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:22.849689 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-67322db0-7cc0-45f9-bf89-f3c2dca8176c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:22.857297 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-67322db0-7cc0-45f9-bf89-f3c2dca8176c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1367 microversion: 2.1 time: 0.154679 Sep 17 21:10:22.857858 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 333/679] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:22 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:23.880703 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-42cd4be8-a066-4f9d-8a27-61d981f8b818 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:23.881434 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-42cd4be8-a066-4f9d-8a27-61d981f8b818 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:23.887608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42cd4be8-a066-4f9d-8a27-61d981f8b818 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:23.888112 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42cd4be8-a066-4f9d-8a27-61d981f8b818 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:23.888543 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42cd4be8-a066-4f9d-8a27-61d981f8b818 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:23.889261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42cd4be8-a066-4f9d-8a27-61d981f8b818 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:23.889712 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42cd4be8-a066-4f9d-8a27-61d981f8b818 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:23.890128 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42cd4be8-a066-4f9d-8a27-61d981f8b818 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:24.023069 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-42cd4be8-a066-4f9d-8a27-61d981f8b818 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:24.031314 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-42cd4be8-a066-4f9d-8a27-61d981f8b818 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1367 microversion: 2.1 time: 0.155274 Sep 17 21:10:24.031872 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 347/680] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:23 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:25.059148 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-961d147d-8e3c-4d2e-befc-4df4362cf594 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:25.059765 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-961d147d-8e3c-4d2e-befc-4df4362cf594 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:25.066591 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-961d147d-8e3c-4d2e-befc-4df4362cf594 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:25.067340 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-961d147d-8e3c-4d2e-befc-4df4362cf594 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:25.067786 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-961d147d-8e3c-4d2e-befc-4df4362cf594 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:25.068767 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-961d147d-8e3c-4d2e-befc-4df4362cf594 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:25.069226 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-961d147d-8e3c-4d2e-befc-4df4362cf594 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:25.069652 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-961d147d-8e3c-4d2e-befc-4df4362cf594 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:25.310747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-961d147d-8e3c-4d2e-befc-4df4362cf594 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:25.327728 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-961d147d-8e3c-4d2e-befc-4df4362cf594 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1367 microversion: 2.1 time: 0.274407 Sep 17 21:10:25.328301 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 334/681] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:25 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:26.350680 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b80984ab-06e9-41ad-8c44-841166b53410 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:26.351310 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b80984ab-06e9-41ad-8c44-841166b53410 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:26.358164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b80984ab-06e9-41ad-8c44-841166b53410 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:26.358638 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b80984ab-06e9-41ad-8c44-841166b53410 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:26.359073 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b80984ab-06e9-41ad-8c44-841166b53410 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:26.359754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b80984ab-06e9-41ad-8c44-841166b53410 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:26.360201 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b80984ab-06e9-41ad-8c44-841166b53410 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:26.360619 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b80984ab-06e9-41ad-8c44-841166b53410 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:26.489729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b80984ab-06e9-41ad-8c44-841166b53410 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:26.497822 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b80984ab-06e9-41ad-8c44-841166b53410 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1367 microversion: 2.1 time: 0.150959 Sep 17 21:10:26.498388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 348/682] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:26 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:26.796391 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2543c122-eee1-402f-947a-254b5bb2d338 req-2e582d6e-c082-4bea-83dd-85c3ff1a8ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f1be29-b81c-4f72-99e3-979c1aab0af2", "name": "network-vif-plugged", "status": "completed", "tag": "0d83c88e-4130-4aea-9402-15f46ff88289"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:26.806359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2543c122-eee1-402f-947a-254b5bb2d338 req-2e582d6e-c082-4bea-83dd-85c3ff1a8ba6 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:26.806836 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2543c122-eee1-402f-947a-254b5bb2d338 req-2e582d6e-c082-4bea-83dd-85c3ff1a8ba6 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:26.807258 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2543c122-eee1-402f-947a-254b5bb2d338 req-2e582d6e-c082-4bea-83dd-85c3ff1a8ba6 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:26.818394 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2543c122-eee1-402f-947a-254b5bb2d338 req-2e582d6e-c082-4bea-83dd-85c3ff1a8ba6 service nova] Creating event network-vif-plugged:0d83c88e-4130-4aea-9402-15f46ff88289 for instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 on hv-cinder-82651 Sep 17 21:10:26.823892 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2543c122-eee1-402f-947a-254b5bb2d338 req-2e582d6e-c082-4bea-83dd-85c3ff1a8ba6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086226 Sep 17 21:10:26.824435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 335/683] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:27.520433 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-901e0260-9001-4f35-9cbe-c41b013e078e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:27.521084 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-901e0260-9001-4f35-9cbe-c41b013e078e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:27.527388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-901e0260-9001-4f35-9cbe-c41b013e078e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:27.527874 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-901e0260-9001-4f35-9cbe-c41b013e078e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:27.528313 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-901e0260-9001-4f35-9cbe-c41b013e078e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:27.529046 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-901e0260-9001-4f35-9cbe-c41b013e078e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:27.529503 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-901e0260-9001-4f35-9cbe-c41b013e078e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:27.529926 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-901e0260-9001-4f35-9cbe-c41b013e078e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:27.657905 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-901e0260-9001-4f35-9cbe-c41b013e078e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:27.665570 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-901e0260-9001-4f35-9cbe-c41b013e078e tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1367 microversion: 2.1 time: 0.149106 Sep 17 21:10:27.666129 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 349/684] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:27 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:28.689396 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1452afd7-f56b-413d-aee4-a7a590db64bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:28.690121 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1452afd7-f56b-413d-aee4-a7a590db64bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:28.697111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1452afd7-f56b-413d-aee4-a7a590db64bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:28.697593 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1452afd7-f56b-413d-aee4-a7a590db64bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:28.698024 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1452afd7-f56b-413d-aee4-a7a590db64bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:28.698707 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1452afd7-f56b-413d-aee4-a7a590db64bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:28.699160 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1452afd7-f56b-413d-aee4-a7a590db64bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:28.699580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1452afd7-f56b-413d-aee4-a7a590db64bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:28.828127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1452afd7-f56b-413d-aee4-a7a590db64bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:28.835696 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1452afd7-f56b-413d-aee4-a7a590db64bc tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1367 microversion: 2.1 time: 0.151067 Sep 17 21:10:28.836252 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 336/685] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:28 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:29.859482 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dc32677d-ef96-47b0-870a-546ddb674b46 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:29.860025 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dc32677d-ef96-47b0-870a-546ddb674b46 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:29.862472 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:29.863159 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:29.869454 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc32677d-ef96-47b0-870a-546ddb674b46 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:29.869930 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc32677d-ef96-47b0-870a-546ddb674b46 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:29.870364 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc32677d-ef96-47b0-870a-546ddb674b46 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:29.871055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc32677d-ef96-47b0-870a-546ddb674b46 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:29.871509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc32677d-ef96-47b0-870a-546ddb674b46 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:29.871932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc32677d-ef96-47b0-870a-546ddb674b46 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:30.002569 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-dc32677d-ef96-47b0-870a-546ddb674b46 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:30.010771 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dc32677d-ef96-47b0-870a-546ddb674b46 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1557 microversion: 2.1 time: 0.155113 Sep 17 21:10:30.011337 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 350/686] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:29 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:30.033285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a08cc40-cfab-4709-a646-0e76e99769ee tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:30.033760 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a08cc40-cfab-4709-a646-0e76e99769ee tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:30.035779 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:30.041807 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a08cc40-cfab-4709-a646-0e76e99769ee tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:30.042278 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a08cc40-cfab-4709-a646-0e76e99769ee tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:30.042703 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a08cc40-cfab-4709-a646-0e76e99769ee tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:30.043384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a08cc40-cfab-4709-a646-0e76e99769ee tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:30.043833 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a08cc40-cfab-4709-a646-0e76e99769ee tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:30.044249 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a08cc40-cfab-4709-a646-0e76e99769ee tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:30.119603 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a08cc40-cfab-4709-a646-0e76e99769ee tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090047 Sep 17 21:10:30.120187 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 337/687] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 17 21:10:30 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:31.280285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0d463500-d775-476c-99b0-286e5d5a1e8c req-d357d0b7-2d44-4f9f-8458-1ec67a886d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f1be29-b81c-4f72-99e3-979c1aab0af2", "tag": "0d83c88e-4130-4aea-9402-15f46ff88289"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:31.290331 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0d463500-d775-476c-99b0-286e5d5a1e8c req-d357d0b7-2d44-4f9f-8458-1ec67a886d34 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:31.291470 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0d463500-d775-476c-99b0-286e5d5a1e8c req-d357d0b7-2d44-4f9f-8458-1ec67a886d34 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:31.292148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0d463500-d775-476c-99b0-286e5d5a1e8c req-d357d0b7-2d44-4f9f-8458-1ec67a886d34 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:31.303292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0d463500-d775-476c-99b0-286e5d5a1e8c req-d357d0b7-2d44-4f9f-8458-1ec67a886d34 service nova] Creating event network-changed:0d83c88e-4130-4aea-9402-15f46ff88289 for instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 on hv-cinder-82651 Sep 17 21:10:31.308498 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0d463500-d775-476c-99b0-286e5d5a1e8c req-d357d0b7-2d44-4f9f-8458-1ec67a886d34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032822 Sep 17 21:10:31.309124 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 351/688] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:54.187604 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:54.188399 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=22 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:54.193512 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c96aa97-b641-43e2-9b94-bf6833758a0b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:54.193994 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c96aa97-b641-43e2-9b94-bf6833758a0b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:54.201288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c96aa97-b641-43e2-9b94-bf6833758a0b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:54.201768 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c96aa97-b641-43e2-9b94-bf6833758a0b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:54.202198 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c96aa97-b641-43e2-9b94-bf6833758a0b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:54.202872 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c96aa97-b641-43e2-9b94-bf6833758a0b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:54.203320 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c96aa97-b641-43e2-9b94-bf6833758a0b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:54.203737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c96aa97-b641-43e2-9b94-bf6833758a0b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:54.234257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c96aa97-b641-43e2-9b94-bf6833758a0b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/os-volume_attachments/12d4c6b0-ea1b-4c0a-83c6-7d3534313bdf" status: 200 len: 194 microversion: 2.20 time: 0.048010 Sep 17 21:10:54.234825 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 338/689] 10.222.0.16 () {60 vars in 1454 bytes} [Sat Sep 17 21:10:54 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/os-volume_attachments/12d4c6b0-ea1b-4c0a-83c6-7d3534313bdf => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:10:54.301955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:54.302686 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=39 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:54.308080 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc2dd7dd-8849-48fe-a6ae-4aba1f0b7b2e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:54.308653 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc2dd7dd-8849-48fe-a6ae-4aba1f0b7b2e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:54.316129 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc2dd7dd-8849-48fe-a6ae-4aba1f0b7b2e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:54.316690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc2dd7dd-8849-48fe-a6ae-4aba1f0b7b2e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:54.317127 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc2dd7dd-8849-48fe-a6ae-4aba1f0b7b2e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:54.318065 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc2dd7dd-8849-48fe-a6ae-4aba1f0b7b2e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:54.318516 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc2dd7dd-8849-48fe-a6ae-4aba1f0b7b2e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:54.318934 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc2dd7dd-8849-48fe-a6ae-4aba1f0b7b2e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:54.398827 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-cc2dd7dd-8849-48fe-a6ae-4aba1f0b7b2e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lazy-loading 'services' on Instance uuid 785212fb-7493-49ce-b3f0-12b3742b3a88 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:10:54.470904 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc2dd7dd-8849-48fe-a6ae-4aba1f0b7b2e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "DELETE /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/os-volume_attachments/12d4c6b0-ea1b-4c0a-83c6-7d3534313bdf" status: 202 len: 0 microversion: 2.20 time: 0.170269 Sep 17 21:10:54.471540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 352/690] 10.222.0.16 () {60 vars in 1457 bytes} [Sat Sep 17 21:10:54 2022] DELETE /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/os-volume_attachments/12d4c6b0-ea1b-4c0a-83c6-7d3534313bdf => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:10:54.481033 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9359c3f9-d437-4f57-bc70-47026af252f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:54.483248 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9359c3f9-d437-4f57-bc70-47026af252f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:54.489198 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9359c3f9-d437-4f57-bc70-47026af252f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:54.489713 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9359c3f9-d437-4f57-bc70-47026af252f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:54.490189 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9359c3f9-d437-4f57-bc70-47026af252f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:54.490983 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9359c3f9-d437-4f57-bc70-47026af252f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:54.491555 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9359c3f9-d437-4f57-bc70-47026af252f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:54.492016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9359c3f9-d437-4f57-bc70-47026af252f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:54.524102 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9359c3f9-d437-4f57-bc70-47026af252f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048149 Sep 17 21:10:54.525520 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 339/691] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Sep 17 21:10:54 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:10:55.538730 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3577cc5f-f8fe-46e8-970e-9da0a83a8cc7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:55.541587 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3577cc5f-f8fe-46e8-970e-9da0a83a8cc7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:55.547786 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3577cc5f-f8fe-46e8-970e-9da0a83a8cc7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:55.548274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3577cc5f-f8fe-46e8-970e-9da0a83a8cc7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:55.548745 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3577cc5f-f8fe-46e8-970e-9da0a83a8cc7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:55.549440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3577cc5f-f8fe-46e8-970e-9da0a83a8cc7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:55.549896 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3577cc5f-f8fe-46e8-970e-9da0a83a8cc7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:55.550323 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3577cc5f-f8fe-46e8-970e-9da0a83a8cc7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:55.579336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3577cc5f-f8fe-46e8-970e-9da0a83a8cc7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045341 Sep 17 21:10:55.579882 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 353/692] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Sep 17 21:10:55 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:55.643530 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-807052bb-7770-4da9-bf4a-e9a8cd067b08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:55.644012 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-807052bb-7770-4da9-bf4a-e9a8cd067b08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:55.650537 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-807052bb-7770-4da9-bf4a-e9a8cd067b08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:55.651017 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-807052bb-7770-4da9-bf4a-e9a8cd067b08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:55.651455 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-807052bb-7770-4da9-bf4a-e9a8cd067b08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:55.652146 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-807052bb-7770-4da9-bf4a-e9a8cd067b08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:55.652601 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-807052bb-7770-4da9-bf4a-e9a8cd067b08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:55.653063 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-807052bb-7770-4da9-bf4a-e9a8cd067b08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:55.678213 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-807052bb-7770-4da9-bf4a-e9a8cd067b08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:10:55.753658 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-807052bb-7770-4da9-bf4a-e9a8cd067b08 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "DELETE /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 204 len: 0 microversion: 2.20 time: 0.113716 Sep 17 21:10:55.754338 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 340/693] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 17 21:10:55 2022] DELETE /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:10:55.763550 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-47296c0f-abe4-4d3a-9937-32674ab44407 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:55.764301 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-47296c0f-abe4-4d3a-9937-32674ab44407 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:55.770695 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47296c0f-abe4-4d3a-9937-32674ab44407 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:55.771182 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47296c0f-abe4-4d3a-9937-32674ab44407 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:55.771620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47296c0f-abe4-4d3a-9937-32674ab44407 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:55.772313 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47296c0f-abe4-4d3a-9937-32674ab44407 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:55.772820 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47296c0f-abe4-4d3a-9937-32674ab44407 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:55.773249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47296c0f-abe4-4d3a-9937-32674ab44407 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:55.902163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-47296c0f-abe4-4d3a-9937-32674ab44407 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:55.910213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-47296c0f-abe4-4d3a-9937-32674ab44407 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:55.911654 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-47296c0f-abe4-4d3a-9937-32674ab44407 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:55.912837 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-47296c0f-abe4-4d3a-9937-32674ab44407 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.153989 Sep 17 21:10:55.913390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 354/694] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:55 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:56.939870 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d760abdf-d5fd-4a47-8bc6-4ed3d851e7bd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:56.940573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d760abdf-d5fd-4a47-8bc6-4ed3d851e7bd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:56.947374 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d760abdf-d5fd-4a47-8bc6-4ed3d851e7bd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:56.947863 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d760abdf-d5fd-4a47-8bc6-4ed3d851e7bd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:56.948303 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d760abdf-d5fd-4a47-8bc6-4ed3d851e7bd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:56.949036 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d760abdf-d5fd-4a47-8bc6-4ed3d851e7bd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:56.949497 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d760abdf-d5fd-4a47-8bc6-4ed3d851e7bd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:56.949926 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d760abdf-d5fd-4a47-8bc6-4ed3d851e7bd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:57.082621 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d760abdf-d5fd-4a47-8bc6-4ed3d851e7bd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:57.090917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d760abdf-d5fd-4a47-8bc6-4ed3d851e7bd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:57.092362 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d760abdf-d5fd-4a47-8bc6-4ed3d851e7bd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:57.093543 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d760abdf-d5fd-4a47-8bc6-4ed3d851e7bd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.158049 Sep 17 21:10:57.094111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 341/695] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:56 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:58.119930 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f81cb750-988b-4a92-864d-018425155ad5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:58.120568 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f81cb750-988b-4a92-864d-018425155ad5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:58.126398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f81cb750-988b-4a92-864d-018425155ad5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:58.126880 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f81cb750-988b-4a92-864d-018425155ad5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:58.127328 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f81cb750-988b-4a92-864d-018425155ad5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:58.128019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f81cb750-988b-4a92-864d-018425155ad5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:58.128474 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f81cb750-988b-4a92-864d-018425155ad5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:58.128920 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f81cb750-988b-4a92-864d-018425155ad5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:58.355870 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f81cb750-988b-4a92-864d-018425155ad5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:58.364090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f81cb750-988b-4a92-864d-018425155ad5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:58.365568 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f81cb750-988b-4a92-864d-018425155ad5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:58.366729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f81cb750-988b-4a92-864d-018425155ad5 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 200 len: 1723 microversion: 2.20 time: 0.251214 Sep 17 21:10:58.367286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 355/696] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:58 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:58.581205 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-44b6aa12-f5c3-4409-a0cf-9cf9370312ad req-6ce05a7e-9c62-416a-b66a-00fbd89127b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785212fb-7493-49ce-b3f0-12b3742b3a88", "name": "network-vif-deleted", "tag": "3a9a1b04-a0c4-4a66-a693-a268f50c530b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:58.591351 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-44b6aa12-f5c3-4409-a0cf-9cf9370312ad req-6ce05a7e-9c62-416a-b66a-00fbd89127b1 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:58.591834 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-44b6aa12-f5c3-4409-a0cf-9cf9370312ad req-6ce05a7e-9c62-416a-b66a-00fbd89127b1 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:58.592261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-44b6aa12-f5c3-4409-a0cf-9cf9370312ad req-6ce05a7e-9c62-416a-b66a-00fbd89127b1 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:58.604293 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-44b6aa12-f5c3-4409-a0cf-9cf9370312ad req-6ce05a7e-9c62-416a-b66a-00fbd89127b1 service nova] Creating event network-vif-deleted:3a9a1b04-a0c4-4a66-a693-a268f50c530b for instance 785212fb-7493-49ce-b3f0-12b3742b3a88 on hv-cinder-82651 Sep 17 21:10:58.609155 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-44b6aa12-f5c3-4409-a0cf-9cf9370312ad req-6ce05a7e-9c62-416a-b66a-00fbd89127b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031507 Sep 17 21:10:58.610081 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 342/697] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:59.285431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7c5b9334-419e-4def-ac49-0d5cad7b5d07 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:59.286503 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7c5b9334-419e-4def-ac49-0d5cad7b5d07 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:59.293850 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c5b9334-419e-4def-ac49-0d5cad7b5d07 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:59.294582 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c5b9334-419e-4def-ac49-0d5cad7b5d07 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:59.295017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c5b9334-419e-4def-ac49-0d5cad7b5d07 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:59.295713 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c5b9334-419e-4def-ac49-0d5cad7b5d07 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:59.296335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c5b9334-419e-4def-ac49-0d5cad7b5d07 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:59.296786 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c5b9334-419e-4def-ac49-0d5cad7b5d07 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:59.382009 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-7c5b9334-419e-4def-ac49-0d5cad7b5d07 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lazy-loading 'services' on Instance uuid 643a631e-9207-4669-a0bb-623a4a8ebf94 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:10:59.394155 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c6258ec-e4da-47bb-8dd4-d7be389ecce6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:59.394276 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c6258ec-e4da-47bb-8dd4-d7be389ecce6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:59.400629 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c6258ec-e4da-47bb-8dd4-d7be389ecce6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:59.401374 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c6258ec-e4da-47bb-8dd4-d7be389ecce6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:59.401808 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c6258ec-e4da-47bb-8dd4-d7be389ecce6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:59.402503 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c6258ec-e4da-47bb-8dd4-d7be389ecce6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:59.402953 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c6258ec-e4da-47bb-8dd4-d7be389ecce6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:59.403371 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c6258ec-e4da-47bb-8dd4-d7be389ecce6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:59.417592 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-4c6258ec-e4da-47bb-8dd4-d7be389ecce6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] HTTP exception thrown: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c6258ec-e4da-47bb-8dd4-d7be389ecce6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Request method failure captured: Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 HTTP/1.1 Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjbY67QsthoGPVIH5wsZ6UE0ZXF4vAngHarTJHG7zuiWMkZFzNUvN_h0xHOnc1ker2zx9T9-SdtTIX-wUg6zFdFEoZ3aHhieg0qiMeqFB7CqQ9CN7VnWFlyNZBXZX8THngcZ5BK2D7cFCDIQOqkgYu7cBZ89ZETAbDxSdfMeZW4bZVU Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: c1913d0c899c48ab9a7781a9e45ac4a9 Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:10:59.419147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:10:59.420851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:10:59.420851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:10:59.420851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: c1913d0c899c48ab9a7781a9e45ac4a9 Sep 17 21:10:59.420851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:10:59.420851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1358903316-project Sep 17 21:10:59.420851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:10:59.420851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:10:59.420851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1dc5f1d34cad437ea15efb98a0a1ca31 Sep 17 21:10:59.420851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1358903316-project Sep 17 21:10:59.420851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:10:59.420851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:10:59.420851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '785212fb-7493-49ce-b3f0-12b3742b3a88'} Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:59.421734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:10:59.423209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:10:59.424581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c6258ec-e4da-47bb-8dd4-d7be389ecce6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Returning 404 to user: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:59.424581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c6258ec-e4da-47bb-8dd4-d7be389ecce6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 404 len: 111 microversion: 2.20 time: 0.031623 Sep 17 21:10:59.424581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 343/698] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:59 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 17 21:10:59.429389 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-57af4d87-4edd-4141-90a6-b35fcd8d4134 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '.version_select at 0x7f9baad46c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:59.450538 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-57af4d87-4edd-4141-90a6-b35fcd8d4134 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378285587" status: 204 len: 0 microversion: 2.20 time: 0.024658 Sep 17 21:10:59.451636 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 344/699] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 17 21:10:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378285587 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:10:59.470771 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7c5b9334-419e-4def-ac49-0d5cad7b5d07 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "DELETE /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-volume_attachments/66c9fa72-73b3-4c90-9fe9-1ba51ca9163c" status: 202 len: 0 microversion: 2.1 time: 0.189294 Sep 17 21:10:59.471384 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 356/700] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 17 21:10:59 2022] DELETE /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-volume_attachments/66c9fa72-73b3-4c90-9fe9-1ba51ca9163c => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:10:59.480662 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cc63e8dc-468f-4dd8-8c6c-e3aac3fbd658 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:59.483354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cc63e8dc-468f-4dd8-8c6c-e3aac3fbd658 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:59.490923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc63e8dc-468f-4dd8-8c6c-e3aac3fbd658 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:59.491405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc63e8dc-468f-4dd8-8c6c-e3aac3fbd658 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:59.491865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc63e8dc-468f-4dd8-8c6c-e3aac3fbd658 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:59.492591 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc63e8dc-468f-4dd8-8c6c-e3aac3fbd658 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:59.493409 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc63e8dc-468f-4dd8-8c6c-e3aac3fbd658 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:59.493838 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc63e8dc-468f-4dd8-8c6c-e3aac3fbd658 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:59.527109 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cc63e8dc-468f-4dd8-8c6c-e3aac3fbd658 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051119 Sep 17 21:10:59.527866 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 345/701] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:10:59 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:00.111796 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f312a7a-faa6-4328-83a1-a64215d5f008 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Action: 'create', calling method: .version_select at 0x7f9ba73483a0>, body: {"keypair": {"name": "tempest-keypair-505406497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8sKDb6GdFnTtugfvfSYf8RD78qw3uQfymQ/wYKHWxq+ZdMFV1e7Jwjp/oqnIsAgpLdbx6LoQK001CyHotB8BcWl/Kk4APKuY4/MQdyu4eTNGxXTUOLcusX1JKWuBQOpA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:00.127947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-5f312a7a-faa6-4328-83a1-a64215d5f008 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Getting quotas for project c1913d0c899c48ab9a7781a9e45ac4a9. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:11:00.131873 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-5f312a7a-faa6-4328-83a1-a64215d5f008 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Getting quotas for user 1dc5f1d34cad437ea15efb98a0a1ca31 and project c1913d0c899c48ab9a7781a9e45ac4a9. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:11:00.153909 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f312a7a-faa6-4328-83a1-a64215d5f008 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046430 Sep 17 21:11:00.154558 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 357/702] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Sep 17 21:11:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 17 21:11:00.540385 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4df12ce0-18fc-4ee9-9e98-e55ed06ad93d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:00.542523 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4df12ce0-18fc-4ee9-9e98-e55ed06ad93d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:00.549172 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4df12ce0-18fc-4ee9-9e98-e55ed06ad93d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:00.549686 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4df12ce0-18fc-4ee9-9e98-e55ed06ad93d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:00.550125 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4df12ce0-18fc-4ee9-9e98-e55ed06ad93d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:00.550858 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4df12ce0-18fc-4ee9-9e98-e55ed06ad93d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:00.551313 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4df12ce0-18fc-4ee9-9e98-e55ed06ad93d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:00.551736 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4df12ce0-18fc-4ee9-9e98-e55ed06ad93d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:00.583106 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4df12ce0-18fc-4ee9-9e98-e55ed06ad93d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047442 Sep 17 21:11:00.583667 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 346/703] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:11:00 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:11:00.668765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2595f305-c4ce-4a8e-8232-d4eee3632426 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:00.669465 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2595f305-c4ce-4a8e-8232-d4eee3632426 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:00.676239 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2595f305-c4ce-4a8e-8232-d4eee3632426 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:00.676833 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2595f305-c4ce-4a8e-8232-d4eee3632426 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:00.677336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2595f305-c4ce-4a8e-8232-d4eee3632426 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:00.678097 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2595f305-c4ce-4a8e-8232-d4eee3632426 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:00.678620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2595f305-c4ce-4a8e-8232-d4eee3632426 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:00.679132 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2595f305-c4ce-4a8e-8232-d4eee3632426 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:00.707180 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2595f305-c4ce-4a8e-8232-d4eee3632426 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:11:00.787098 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2595f305-c4ce-4a8e-8232-d4eee3632426 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "DELETE /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 204 len: 0 microversion: 2.1 time: 0.123062 Sep 17 21:11:00.787713 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 358/704] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:00 2022] DELETE /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:11:00.797110 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2dc7f0df-2aec-4432-b16e-c39847ce362f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:00.797830 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2dc7f0df-2aec-4432-b16e-c39847ce362f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:00.803974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dc7f0df-2aec-4432-b16e-c39847ce362f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:00.804528 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dc7f0df-2aec-4432-b16e-c39847ce362f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:00.805054 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dc7f0df-2aec-4432-b16e-c39847ce362f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:00.805825 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dc7f0df-2aec-4432-b16e-c39847ce362f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:00.806342 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dc7f0df-2aec-4432-b16e-c39847ce362f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:00.806832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dc7f0df-2aec-4432-b16e-c39847ce362f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:00.938220 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2dc7f0df-2aec-4432-b16e-c39847ce362f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:00.947276 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2dc7f0df-2aec-4432-b16e-c39847ce362f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1688 microversion: 2.1 time: 0.154851 Sep 17 21:11:00.947940 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 347/705] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:00 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:01.411377 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-59455022", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c55663b-3b93-47c5-8d74-f84d3023d441"}], "security_groups": [{"name": "tempest-securitygroup--2116638257"}], "key_name": "tempest-keypair-505406497", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:01.513165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] validate_networks() for [('5c55663b-3b93-47c5-8d74-f84d3023d441', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:11:01.880007 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:11:01.880571 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:11:01.880916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:11:01.881360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:11:01.881770 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:11:01.890950 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:01.891439 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:01.891868 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:01.892596 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:01.893083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:01.893509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:01.910112 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Getting quotas for project c1913d0c899c48ab9a7781a9e45ac4a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:11:01.913990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Getting quotas for user 1dc5f1d34cad437ea15efb98a0a1ca31 and project c1913d0c899c48ab9a7781a9e45ac4a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:11:01.925134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:11:01.927496 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:11:01.969618 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5ace2400-baf7-4e7c-adb5-830ed8c89c1a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:01.970223 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5ace2400-baf7-4e7c-adb5-830ed8c89c1a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:01.976386 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ace2400-baf7-4e7c-adb5-830ed8c89c1a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:01.976911 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ace2400-baf7-4e7c-adb5-830ed8c89c1a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:01.977352 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ace2400-baf7-4e7c-adb5-830ed8c89c1a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:01.978046 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ace2400-baf7-4e7c-adb5-830ed8c89c1a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:01.978504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ace2400-baf7-4e7c-adb5-830ed8c89c1a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:01.978811 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b17c995f-12cc-442c-ab77-faaceeb99238 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.572118 Sep 17 21:11:01.978929 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ace2400-baf7-4e7c-adb5-830ed8c89c1a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:01.979632 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 359/706] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 17 21:11:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 21:11:01.991215 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b5ff4b9-31d5-4527-aa1c-90fc72d66528 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:01.991929 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8b5ff4b9-31d5-4527-aa1c-90fc72d66528 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:02.071827 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b5ff4b9-31d5-4527-aa1c-90fc72d66528 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:02.080180 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b5ff4b9-31d5-4527-aa1c-90fc72d66528 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:02.081793 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b5ff4b9-31d5-4527-aa1c-90fc72d66528 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:02.082933 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b5ff4b9-31d5-4527-aa1c-90fc72d66528 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1279 microversion: 2.20 time: 0.095580 Sep 17 21:11:02.083644 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 360/707] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:01 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:02.141720 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5ace2400-baf7-4e7c-adb5-830ed8c89c1a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:02.150358 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5ace2400-baf7-4e7c-adb5-830ed8c89c1a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1688 microversion: 2.1 time: 0.184610 Sep 17 21:11:02.151005 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 348/708] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:01 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:03.108745 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-30c62165-ff39-45f3-a229-d3d4cd9ea6a6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:03.109366 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-30c62165-ff39-45f3-a229-d3d4cd9ea6a6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:03.116399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30c62165-ff39-45f3-a229-d3d4cd9ea6a6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:03.116927 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30c62165-ff39-45f3-a229-d3d4cd9ea6a6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:03.117371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30c62165-ff39-45f3-a229-d3d4cd9ea6a6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:03.118827 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30c62165-ff39-45f3-a229-d3d4cd9ea6a6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:03.119342 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30c62165-ff39-45f3-a229-d3d4cd9ea6a6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:03.119784 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30c62165-ff39-45f3-a229-d3d4cd9ea6a6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:03.174302 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4ee8b32f-8dbd-4409-a44f-a72398082c9d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:03.174908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4ee8b32f-8dbd-4409-a44f-a72398082c9d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:03.181267 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-30c62165-ff39-45f3-a229-d3d4cd9ea6a6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:03.182365 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ee8b32f-8dbd-4409-a44f-a72398082c9d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:03.182852 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ee8b32f-8dbd-4409-a44f-a72398082c9d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:03.183469 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ee8b32f-8dbd-4409-a44f-a72398082c9d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:03.184165 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ee8b32f-8dbd-4409-a44f-a72398082c9d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:03.185218 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ee8b32f-8dbd-4409-a44f-a72398082c9d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:03.185643 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ee8b32f-8dbd-4409-a44f-a72398082c9d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:03.190594 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-30c62165-ff39-45f3-a229-d3d4cd9ea6a6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:03.190791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-30c62165-ff39-45f3-a229-d3d4cd9ea6a6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:03.191892 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-30c62165-ff39-45f3-a229-d3d4cd9ea6a6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1283 microversion: 2.20 time: 0.087053 Sep 17 21:11:03.192717 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 361/709] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:03 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1283 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:03.330989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ee8b32f-8dbd-4409-a44f-a72398082c9d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:03.339742 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4ee8b32f-8dbd-4409-a44f-a72398082c9d tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1688 microversion: 2.1 time: 0.169181 Sep 17 21:11:03.340308 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 349/710] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:03 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:04.217574 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-02c2cd62-4397-49bf-9442-834153b55949 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:04.218289 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-02c2cd62-4397-49bf-9442-834153b55949 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:04.225926 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02c2cd62-4397-49bf-9442-834153b55949 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:04.226417 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02c2cd62-4397-49bf-9442-834153b55949 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:04.227189 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02c2cd62-4397-49bf-9442-834153b55949 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:04.227907 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02c2cd62-4397-49bf-9442-834153b55949 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:04.228464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02c2cd62-4397-49bf-9442-834153b55949 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:04.228905 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02c2cd62-4397-49bf-9442-834153b55949 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:04.317270 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-02c2cd62-4397-49bf-9442-834153b55949 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:04.326633 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-02c2cd62-4397-49bf-9442-834153b55949 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:04.328212 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-02c2cd62-4397-49bf-9442-834153b55949 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:04.329360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-02c2cd62-4397-49bf-9442-834153b55949 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1331 microversion: 2.20 time: 0.115786 Sep 17 21:11:04.329913 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 362/711] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:04 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:04.364022 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-12d1414f-75ac-41b6-a53f-6693068176ec tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:04.364794 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-12d1414f-75ac-41b6-a53f-6693068176ec tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:04.372333 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12d1414f-75ac-41b6-a53f-6693068176ec tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:04.372860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12d1414f-75ac-41b6-a53f-6693068176ec tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:04.373532 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12d1414f-75ac-41b6-a53f-6693068176ec tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:04.374587 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12d1414f-75ac-41b6-a53f-6693068176ec tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:04.375108 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12d1414f-75ac-41b6-a53f-6693068176ec tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:04.375756 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12d1414f-75ac-41b6-a53f-6693068176ec tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:04.590990 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-12d1414f-75ac-41b6-a53f-6693068176ec tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:04.598722 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-12d1414f-75ac-41b6-a53f-6693068176ec tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1688 microversion: 2.1 time: 0.238562 Sep 17 21:11:04.599292 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 350/712] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:04 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1688 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:05.177481 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b7eb9d44-5112-41d7-b627-2061558ec8e7 req-62452fa7-4d98-4dcc-aabc-aa0d4988ca68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643a631e-9207-4669-a0bb-623a4a8ebf94", "name": "network-vif-deleted", "tag": "29f4bfa6-fb19-459c-af27-5bbb69ad95bd"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:05.198157 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b7eb9d44-5112-41d7-b627-2061558ec8e7 req-62452fa7-4d98-4dcc-aabc-aa0d4988ca68 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:05.198657 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b7eb9d44-5112-41d7-b627-2061558ec8e7 req-62452fa7-4d98-4dcc-aabc-aa0d4988ca68 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:05.199294 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b7eb9d44-5112-41d7-b627-2061558ec8e7 req-62452fa7-4d98-4dcc-aabc-aa0d4988ca68 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:05.217179 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b7eb9d44-5112-41d7-b627-2061558ec8e7 req-62452fa7-4d98-4dcc-aabc-aa0d4988ca68 service nova] Creating event network-vif-deleted:29f4bfa6-fb19-459c-af27-5bbb69ad95bd for instance 643a631e-9207-4669-a0bb-623a4a8ebf94 on hv-cinder-82651 Sep 17 21:11:05.222515 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b7eb9d44-5112-41d7-b627-2061558ec8e7 req-62452fa7-4d98-4dcc-aabc-aa0d4988ca68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049510 Sep 17 21:11:05.227704 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 363/713] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:05.354635 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89de2993-a800-488b-b041-f1b6f5bc63be tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:05.355908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89de2993-a800-488b-b041-f1b6f5bc63be tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:05.365435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89de2993-a800-488b-b041-f1b6f5bc63be tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:05.366836 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89de2993-a800-488b-b041-f1b6f5bc63be tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:05.367519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89de2993-a800-488b-b041-f1b6f5bc63be tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:05.369346 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89de2993-a800-488b-b041-f1b6f5bc63be tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:05.370006 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89de2993-a800-488b-b041-f1b6f5bc63be tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:05.370647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89de2993-a800-488b-b041-f1b6f5bc63be tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:05.595027 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-89de2993-a800-488b-b041-f1b6f5bc63be tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:05.608289 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-89de2993-a800-488b-b041-f1b6f5bc63be tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:05.612785 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-89de2993-a800-488b-b041-f1b6f5bc63be tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:05.614486 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89de2993-a800-488b-b041-f1b6f5bc63be tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1405 microversion: 2.20 time: 0.264531 Sep 17 21:11:05.615040 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 351/714] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:05 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1405 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:05.624070 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:05.624935 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:05.634652 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:05.635651 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:05.636335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:05.637326 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:05.638338 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:05.652787 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:05.701466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:05.702562 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:05.703444 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:05.704197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lazy-loading 'fault' on Instance uuid 643a631e-9207-4669-a0bb-623a4a8ebf94 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:11:05.754345 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:05.765564 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-68edab73-0571-4bdf-97be-ad8f4db9ce85 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 200 len: 1335 microversion: 2.1 time: 0.146711 Sep 17 21:11:05.766333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 364/715] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:05 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 1335 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:06.420007 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-bfe8ac8e-0c2b-47a0-a293-0bfcf8080982 req-3bebc4cd-fe16-4b48-80af-52c51f5bf08b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a67b77-200a-44df-918e-757ee2cae914", "tag": "26d391cd-62d3-4e74-b7fe-db22e47cae57"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:06.429722 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bfe8ac8e-0c2b-47a0-a293-0bfcf8080982 req-3bebc4cd-fe16-4b48-80af-52c51f5bf08b service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:06.430257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bfe8ac8e-0c2b-47a0-a293-0bfcf8080982 req-3bebc4cd-fe16-4b48-80af-52c51f5bf08b service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:06.431047 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bfe8ac8e-0c2b-47a0-a293-0bfcf8080982 req-3bebc4cd-fe16-4b48-80af-52c51f5bf08b service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:06.442249 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-bfe8ac8e-0c2b-47a0-a293-0bfcf8080982 req-3bebc4cd-fe16-4b48-80af-52c51f5bf08b service nova] Creating event network-changed:26d391cd-62d3-4e74-b7fe-db22e47cae57 for instance 60a67b77-200a-44df-918e-757ee2cae914 on hv-cinder-82651 Sep 17 21:11:06.448184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-bfe8ac8e-0c2b-47a0-a293-0bfcf8080982 req-3bebc4cd-fe16-4b48-80af-52c51f5bf08b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109789 Sep 17 21:11:06.449108 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 352/716] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:06.644909 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-37c3bc19-bda5-431f-b1e9-d7da320163c1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:06.645732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-37c3bc19-bda5-431f-b1e9-d7da320163c1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:06.652658 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37c3bc19-bda5-431f-b1e9-d7da320163c1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:06.653165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37c3bc19-bda5-431f-b1e9-d7da320163c1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:06.653598 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37c3bc19-bda5-431f-b1e9-d7da320163c1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:06.654284 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37c3bc19-bda5-431f-b1e9-d7da320163c1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:06.654729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37c3bc19-bda5-431f-b1e9-d7da320163c1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:06.655149 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37c3bc19-bda5-431f-b1e9-d7da320163c1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:06.790988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4a06670f-d6bd-4b69-b821-7d22026d971a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:06.791385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-37c3bc19-bda5-431f-b1e9-d7da320163c1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:06.791694 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4a06670f-d6bd-4b69-b821-7d22026d971a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 643a631e-9207-4669-a0bb-623a4a8ebf94] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:06.797920 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a06670f-d6bd-4b69-b821-7d22026d971a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:06.798404 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a06670f-d6bd-4b69-b821-7d22026d971a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:06.798839 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a06670f-d6bd-4b69-b821-7d22026d971a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:06.799277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-37c3bc19-bda5-431f-b1e9-d7da320163c1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:06.799537 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a06670f-d6bd-4b69-b821-7d22026d971a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:06.799994 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a06670f-d6bd-4b69-b821-7d22026d971a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:06.800420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a06670f-d6bd-4b69-b821-7d22026d971a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:06.800722 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-37c3bc19-bda5-431f-b1e9-d7da320163c1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:06.802115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-37c3bc19-bda5-431f-b1e9-d7da320163c1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1405 microversion: 2.20 time: 0.161365 Sep 17 21:11:06.802663 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 365/717] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:06 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:06.814450 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-4a06670f-d6bd-4b69-b821-7d22026d971a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] HTTP exception thrown: Instance 643a631e-9207-4669-a0bb-623a4a8ebf94 could not be found. Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4a06670f-d6bd-4b69-b821-7d22026d971a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Request method failure captured: Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 HTTP/1.1 Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZZwKfTj04T6UZy5whU5GnH06Qm2mjPMAvhRhYAf6YKOkKlLcdEUkYnhTcpRVF99d6zOw51Eu4MKu4qSCJA2DfrmeduSv2CPcOO2IOE6No0aJf0pyRwS9JPzSXJja0gkzZZ92NWtZdGv-AVZ4Zt9rvw5MPu-tY6pkTxKJ91Ococ8o8 Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: 1e42842c724f480f9cdd5ea75707b43f Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:11:06.816069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:11:06.817923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:11:06.817923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:11:06.817923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 1e42842c724f480f9cdd5ea75707b43f Sep 17 21:11:06.817923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:11:06.817923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-ServerRescueNegativeTestJSON-593011089-project Sep 17 21:11:06.817923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:11:06.817923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:11:06.817923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: a3dac44116784a9e963a69e4793bac4b Sep 17 21:11:06.817923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593011089-project Sep 17 21:11:06.817923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:11:06.817923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 643a631e-9207-4669-a0bb-623a4a8ebf94 could not be found. Sep 17 21:11:06.817923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '643a631e-9207-4669-a0bb-623a4a8ebf94'} Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 643a631e-9207-4669-a0bb-623a4a8ebf94 could not be found. Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:06.819573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 643a631e-9207-4669-a0bb-623a4a8ebf94 could not be found. Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 643a631e-9207-4669-a0bb-623a4a8ebf94 could not be found. Sep 17 21:11:06.821405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:06.822740 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4a06670f-d6bd-4b69-b821-7d22026d971a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Returning 404 to user: Instance 643a631e-9207-4669-a0bb-623a4a8ebf94 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:06.822740 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4a06670f-d6bd-4b69-b821-7d22026d971a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94" status: 404 len: 111 microversion: 2.1 time: 0.031608 Sep 17 21:11:06.822740 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 353/718] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:06 2022] GET /compute/v2.1/servers/643a631e-9207-4669-a0bb-623a4a8ebf94 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:11:06.826558 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7f11dc4-cc3e-4c16-884e-8b217e4489ae tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '.version_select at 0x7f9ba72f4ee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:06.844084 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f7f11dc4-cc3e-4c16-884e-8b217e4489ae tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1403007556" status: 202 len: 0 microversion: 2.1 time: 0.021418 Sep 17 21:11:06.844627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 366/719] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 17 21:11:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1403007556 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:11:07.827906 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f18c550-c29e-4472-b628-053038a89843 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:07.828504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2f18c550-c29e-4472-b628-053038a89843 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:07.834988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f18c550-c29e-4472-b628-053038a89843 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:07.835465 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f18c550-c29e-4472-b628-053038a89843 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:07.835896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f18c550-c29e-4472-b628-053038a89843 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:07.836865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f18c550-c29e-4472-b628-053038a89843 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:07.837319 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f18c550-c29e-4472-b628-053038a89843 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:07.837734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f18c550-c29e-4472-b628-053038a89843 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:07.967348 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f18c550-c29e-4472-b628-053038a89843 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:07.975334 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f18c550-c29e-4472-b628-053038a89843 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:07.976843 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f18c550-c29e-4472-b628-053038a89843 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:07.978300 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2f18c550-c29e-4472-b628-053038a89843 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1405 microversion: 2.20 time: 0.154146 Sep 17 21:11:07.978845 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 354/720] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:07 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:09.004118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8028db7-4bf7-4049-b81e-04ac05cb3e18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:09.004700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8028db7-4bf7-4049-b81e-04ac05cb3e18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:09.011509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8028db7-4bf7-4049-b81e-04ac05cb3e18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:09.012006 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8028db7-4bf7-4049-b81e-04ac05cb3e18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:09.012443 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8028db7-4bf7-4049-b81e-04ac05cb3e18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:09.013172 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8028db7-4bf7-4049-b81e-04ac05cb3e18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:09.013805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8028db7-4bf7-4049-b81e-04ac05cb3e18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:09.014387 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8028db7-4bf7-4049-b81e-04ac05cb3e18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:09.154530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8028db7-4bf7-4049-b81e-04ac05cb3e18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:09.162541 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8028db7-4bf7-4049-b81e-04ac05cb3e18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:09.163979 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8028db7-4bf7-4049-b81e-04ac05cb3e18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:09.165644 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8028db7-4bf7-4049-b81e-04ac05cb3e18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1405 microversion: 2.20 time: 0.166005 Sep 17 21:11:09.166194 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 367/721] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:08 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:09.669294 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a7c4fc08-8853-47f6-a646-95a07cdd2a1f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:09.669825 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a7c4fc08-8853-47f6-a646-95a07cdd2a1f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:09.676169 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7c4fc08-8853-47f6-a646-95a07cdd2a1f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:09.676652 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7c4fc08-8853-47f6-a646-95a07cdd2a1f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:09.677116 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7c4fc08-8853-47f6-a646-95a07cdd2a1f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:09.677800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7c4fc08-8853-47f6-a646-95a07cdd2a1f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:09.678253 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7c4fc08-8853-47f6-a646-95a07cdd2a1f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:09.678679 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7c4fc08-8853-47f6-a646-95a07cdd2a1f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:09.705637 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a7c4fc08-8853-47f6-a646-95a07cdd2a1f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:11:09.731526 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:09.779300 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a7c4fc08-8853-47f6-a646-95a07cdd2a1f tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "DELETE /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 204 len: 0 microversion: 2.1 time: 0.114408 Sep 17 21:11:09.780057 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 355/722] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:09 2022] DELETE /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:11:09.787978 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0e0798b9-5a5a-4eb5-86f4-942d45e6107c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:09.788724 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0e0798b9-5a5a-4eb5-86f4-942d45e6107c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:09.794556 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e0798b9-5a5a-4eb5-86f4-942d45e6107c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:09.795031 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e0798b9-5a5a-4eb5-86f4-942d45e6107c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:09.795458 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e0798b9-5a5a-4eb5-86f4-942d45e6107c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:09.796143 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e0798b9-5a5a-4eb5-86f4-942d45e6107c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:09.796588 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e0798b9-5a5a-4eb5-86f4-942d45e6107c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:09.797032 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e0798b9-5a5a-4eb5-86f4-942d45e6107c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:09.922382 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0e0798b9-5a5a-4eb5-86f4-942d45e6107c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:09.931053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0e0798b9-5a5a-4eb5-86f4-942d45e6107c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1506 microversion: 2.1 time: 0.147003 Sep 17 21:11:09.931688 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 368/723] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:09 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:10.190652 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32e351db-004b-4379-9736-db72cc13842b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:10.191371 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32e351db-004b-4379-9736-db72cc13842b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:10.197876 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e351db-004b-4379-9736-db72cc13842b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.198355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e351db-004b-4379-9736-db72cc13842b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.198788 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e351db-004b-4379-9736-db72cc13842b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.199474 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e351db-004b-4379-9736-db72cc13842b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.199926 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e351db-004b-4379-9736-db72cc13842b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.200349 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e351db-004b-4379-9736-db72cc13842b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.598600 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-32e351db-004b-4379-9736-db72cc13842b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:10.607148 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-32e351db-004b-4379-9736-db72cc13842b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:10.608614 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-32e351db-004b-4379-9736-db72cc13842b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:10.609723 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32e351db-004b-4379-9736-db72cc13842b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1405 microversion: 2.20 time: 0.423323 Sep 17 21:11:10.610280 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 356/724] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:10 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:10.858178 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c54a8efc-78a3-4c18-9717-d3ca84e1cba4 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:10.858777 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c54a8efc-78a3-4c18-9717-d3ca84e1cba4 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:10.865624 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c54a8efc-78a3-4c18-9717-d3ca84e1cba4 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.866102 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c54a8efc-78a3-4c18-9717-d3ca84e1cba4 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.866503 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c54a8efc-78a3-4c18-9717-d3ca84e1cba4 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.867198 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c54a8efc-78a3-4c18-9717-d3ca84e1cba4 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.867650 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c54a8efc-78a3-4c18-9717-d3ca84e1cba4 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.868144 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c54a8efc-78a3-4c18-9717-d3ca84e1cba4 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.886020 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:10.892384 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-c54a8efc-78a3-4c18-9717-d3ca84e1cba4 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lazy-loading 'flavor' on Instance uuid 3209ceff-722f-437e-9ece-3f9542c1daa7 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:11:10.936445 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c5b8f1b0-6544-4b1f-9535-a84c9d48cebb req-ac1b807d-1e29-4a48-8233-4c401991cbdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a67b77-200a-44df-918e-757ee2cae914", "name": "network-vif-plugged", "status": "completed", "tag": "26d391cd-62d3-4e74-b7fe-db22e47cae57"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:10.951661 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c5b8f1b0-6544-4b1f-9535-a84c9d48cebb req-ac1b807d-1e29-4a48-8233-4c401991cbdc service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.952238 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c5b8f1b0-6544-4b1f-9535-a84c9d48cebb req-ac1b807d-1e29-4a48-8233-4c401991cbdc service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.952785 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c5b8f1b0-6544-4b1f-9535-a84c9d48cebb req-ac1b807d-1e29-4a48-8233-4c401991cbdc service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.965787 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c5b8f1b0-6544-4b1f-9535-a84c9d48cebb req-ac1b807d-1e29-4a48-8233-4c401991cbdc service nova] Creating event network-vif-plugged:26d391cd-62d3-4e74-b7fe-db22e47cae57 for instance 60a67b77-200a-44df-918e-757ee2cae914 on hv-cinder-82651 Sep 17 21:11:10.968249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c54a8efc-78a3-4c18-9717-d3ca84e1cba4 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "POST /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7/action" status: 202 len: 0 microversion: 2.1 time: 0.113844 Sep 17 21:11:10.968881 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 369/725] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:11:10 2022] POST /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:11:10.971750 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c5b8f1b0-6544-4b1f-9535-a84c9d48cebb req-ac1b807d-1e29-4a48-8233-4c401991cbdc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038958 Sep 17 21:11:10.972636 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 357/726] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:10.979603 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b522daf-3e80-4803-b623-1fd3ad8173d7 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:10.980714 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9b522daf-3e80-4803-b623-1fd3ad8173d7 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:10.982870 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-82f35bb3-c2ba-425d-9d5f-f1474a13b82b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:10.983555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-82f35bb3-c2ba-425d-9d5f-f1474a13b82b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:10.988462 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b522daf-3e80-4803-b623-1fd3ad8173d7 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.989082 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b522daf-3e80-4803-b623-1fd3ad8173d7 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.989664 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b522daf-3e80-4803-b623-1fd3ad8173d7 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.990220 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82f35bb3-c2ba-425d-9d5f-f1474a13b82b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.990493 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b522daf-3e80-4803-b623-1fd3ad8173d7 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.990903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82f35bb3-c2ba-425d-9d5f-f1474a13b82b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.991340 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82f35bb3-c2ba-425d-9d5f-f1474a13b82b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.991517 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b522daf-3e80-4803-b623-1fd3ad8173d7 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.992042 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82f35bb3-c2ba-425d-9d5f-f1474a13b82b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.992819 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82f35bb3-c2ba-425d-9d5f-f1474a13b82b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.993066 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b522daf-3e80-4803-b623-1fd3ad8173d7 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.993344 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82f35bb3-c2ba-425d-9d5f-f1474a13b82b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:11.192875 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-82f35bb3-c2ba-425d-9d5f-f1474a13b82b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:11.201731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-82f35bb3-c2ba-425d-9d5f-f1474a13b82b tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1506 microversion: 2.1 time: 0.231716 Sep 17 21:11:11.202405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 370/727] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:10 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:11.213082 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9b522daf-3e80-4803-b623-1fd3ad8173d7 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:11.221098 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9b522daf-3e80-4803-b623-1fd3ad8173d7 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.247398 Sep 17 21:11:11.221654 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 358/728] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:10 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:11.636040 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-092148a1-742f-4e30-ba4f-57086b5123ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:11.636562 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-092148a1-742f-4e30-ba4f-57086b5123ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:11.642825 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-092148a1-742f-4e30-ba4f-57086b5123ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:11.643316 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-092148a1-742f-4e30-ba4f-57086b5123ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:11.643746 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-092148a1-742f-4e30-ba4f-57086b5123ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:11.644455 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-092148a1-742f-4e30-ba4f-57086b5123ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:11.644935 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-092148a1-742f-4e30-ba4f-57086b5123ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:11.645367 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-092148a1-742f-4e30-ba4f-57086b5123ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:11.785640 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-092148a1-742f-4e30-ba4f-57086b5123ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:11.794375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-092148a1-742f-4e30-ba4f-57086b5123ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:11.795800 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-092148a1-742f-4e30-ba4f-57086b5123ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:11.796921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-092148a1-742f-4e30-ba4f-57086b5123ce tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1405 microversion: 2.20 time: 0.165612 Sep 17 21:11:11.797468 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 371/729] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:11 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:12.123368 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-0ba68eaa-3658-4b75-b1d3-323e12f57559 req-bb97e49a-9319-4313-a3d2-72e22c1fdce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06bc19de-a634-49b9-b594-e66f5a07f584", "name": "network-vif-deleted", "tag": "a8a5bbd2-ce5f-46bf-b7f6-75feb45e9e31"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:12.134245 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0ba68eaa-3658-4b75-b1d3-323e12f57559 req-bb97e49a-9319-4313-a3d2-72e22c1fdce7 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.134723 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0ba68eaa-3658-4b75-b1d3-323e12f57559 req-bb97e49a-9319-4313-a3d2-72e22c1fdce7 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.135344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0ba68eaa-3658-4b75-b1d3-323e12f57559 req-bb97e49a-9319-4313-a3d2-72e22c1fdce7 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:12.146107 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-0ba68eaa-3658-4b75-b1d3-323e12f57559 req-bb97e49a-9319-4313-a3d2-72e22c1fdce7 service nova] Creating event network-vif-deleted:a8a5bbd2-ce5f-46bf-b7f6-75feb45e9e31 for instance 06bc19de-a634-49b9-b594-e66f5a07f584 on hv-cinder-82651 Sep 17 21:11:12.151481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-0ba68eaa-3658-4b75-b1d3-323e12f57559 req-bb97e49a-9319-4313-a3d2-72e22c1fdce7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031978 Sep 17 21:11:12.152064 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 359/730] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:12.225360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-47891c06-6da6-4f9e-8177-3efeb056834e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:12.226135 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-47891c06-6da6-4f9e-8177-3efeb056834e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:12.228996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:12.229689 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=12 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:12.235502 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47891c06-6da6-4f9e-8177-3efeb056834e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.235987 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47891c06-6da6-4f9e-8177-3efeb056834e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.236424 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47891c06-6da6-4f9e-8177-3efeb056834e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:12.237161 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47891c06-6da6-4f9e-8177-3efeb056834e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.237623 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47891c06-6da6-4f9e-8177-3efeb056834e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.238045 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47891c06-6da6-4f9e-8177-3efeb056834e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:12.245847 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5f562ce-37a4-477c-873e-e15702b84520 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:12.246539 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a5f562ce-37a4-477c-873e-e15702b84520 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:12.253047 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5f562ce-37a4-477c-873e-e15702b84520 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.253176 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5f562ce-37a4-477c-873e-e15702b84520 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.253530 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5f562ce-37a4-477c-873e-e15702b84520 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:12.254227 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5f562ce-37a4-477c-873e-e15702b84520 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.254683 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5f562ce-37a4-477c-873e-e15702b84520 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.255106 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5f562ce-37a4-477c-873e-e15702b84520 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:12.308724 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-47891c06-6da6-4f9e-8177-3efeb056834e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:12.316299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-47891c06-6da6-4f9e-8177-3efeb056834e tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1464 microversion: 2.1 time: 0.094728 Sep 17 21:11:12.316903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 372/731] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:12 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1464 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:12.407179 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5f562ce-37a4-477c-873e-e15702b84520 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:12.416723 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a5f562ce-37a4-477c-873e-e15702b84520 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.175014 Sep 17 21:11:12.417655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 360/732] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:12 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:12.823168 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d684efc3-7b5d-46f6-9fa8-aef71e401328 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:12.823780 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d684efc3-7b5d-46f6-9fa8-aef71e401328 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:12.829808 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d684efc3-7b5d-46f6-9fa8-aef71e401328 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.830299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d684efc3-7b5d-46f6-9fa8-aef71e401328 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.830730 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d684efc3-7b5d-46f6-9fa8-aef71e401328 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:12.831584 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d684efc3-7b5d-46f6-9fa8-aef71e401328 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.832184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d684efc3-7b5d-46f6-9fa8-aef71e401328 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.832709 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d684efc3-7b5d-46f6-9fa8-aef71e401328 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:12.964041 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d684efc3-7b5d-46f6-9fa8-aef71e401328 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:12.971992 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d684efc3-7b5d-46f6-9fa8-aef71e401328 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:12.973478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d684efc3-7b5d-46f6-9fa8-aef71e401328 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:12.974629 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d684efc3-7b5d-46f6-9fa8-aef71e401328 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1597 microversion: 2.20 time: 0.155488 Sep 17 21:11:12.975181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 373/733] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:12 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1597 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:13.000227 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e038dc9b-b620-471e-a2ab-61e94c289fdd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:13.000737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e038dc9b-b620-471e-a2ab-61e94c289fdd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:13.006544 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e038dc9b-b620-471e-a2ab-61e94c289fdd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:13.007018 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e038dc9b-b620-471e-a2ab-61e94c289fdd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:13.007448 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e038dc9b-b620-471e-a2ab-61e94c289fdd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:13.008209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e038dc9b-b620-471e-a2ab-61e94c289fdd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:13.008660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e038dc9b-b620-471e-a2ab-61e94c289fdd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:13.009103 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e038dc9b-b620-471e-a2ab-61e94c289fdd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:13.084796 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e038dc9b-b620-471e-a2ab-61e94c289fdd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088362 Sep 17 21:11:13.085383 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 361/734] 10.222.0.16 () {60 vars in 1316 bytes} [Sat Sep 17 21:11:12 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 17 21:11:13.339958 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:13.340509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:13.346810 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:13.347294 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:13.347735 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:13.348441 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:13.348908 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:13.349329 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:13.380727 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:13.381210 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:13.381638 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:13.382077 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lazy-loading 'fault' on Instance uuid 06bc19de-a634-49b9-b594-e66f5a07f584 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:11:13.441997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b62444a0-1210-4b93-91b1-8376a2983a5e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:13.442860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b62444a0-1210-4b93-91b1-8376a2983a5e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:13.449424 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62444a0-1210-4b93-91b1-8376a2983a5e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:13.449910 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62444a0-1210-4b93-91b1-8376a2983a5e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:13.450339 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62444a0-1210-4b93-91b1-8376a2983a5e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:13.451214 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62444a0-1210-4b93-91b1-8376a2983a5e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:13.451665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62444a0-1210-4b93-91b1-8376a2983a5e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:13.452087 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62444a0-1210-4b93-91b1-8376a2983a5e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:13.459791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:13.470679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-764e3a48-8516-4614-9a71-5f989d2a514a tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 200 len: 1311 microversion: 2.1 time: 0.135032 Sep 17 21:11:13.471606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 374/735] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:13 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 1311 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:13.689836 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b62444a0-1210-4b93-91b1-8376a2983a5e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:13.698664 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b62444a0-1210-4b93-91b1-8376a2983a5e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.261765 Sep 17 21:11:13.699233 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 362/736] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:13 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:14.138618 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b2bd4c2f-fe92-44de-b553-8f24621e5741 req-d057f866-f3bc-434b-b213-c44265aae446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a67b77-200a-44df-918e-757ee2cae914", "tag": "26d391cd-62d3-4e74-b7fe-db22e47cae57"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:14.148115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b2bd4c2f-fe92-44de-b553-8f24621e5741 req-d057f866-f3bc-434b-b213-c44265aae446 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.148788 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b2bd4c2f-fe92-44de-b553-8f24621e5741 req-d057f866-f3bc-434b-b213-c44265aae446 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.149556 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b2bd4c2f-fe92-44de-b553-8f24621e5741 req-d057f866-f3bc-434b-b213-c44265aae446 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.160249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b2bd4c2f-fe92-44de-b553-8f24621e5741 req-d057f866-f3bc-434b-b213-c44265aae446 service nova] Creating event network-changed:26d391cd-62d3-4e74-b7fe-db22e47cae57 for instance 60a67b77-200a-44df-918e-757ee2cae914 on hv-cinder-82651 Sep 17 21:11:14.166372 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b2bd4c2f-fe92-44de-b553-8f24621e5741 req-d057f866-f3bc-434b-b213-c44265aae446 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031416 Sep 17 21:11:14.167082 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 375/737] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:14.495011 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2886e88-e909-4b48-a135-508aaa5ba1ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:14.495709 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2886e88-e909-4b48-a135-508aaa5ba1ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 06bc19de-a634-49b9-b594-e66f5a07f584] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:14.502326 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2886e88-e909-4b48-a135-508aaa5ba1ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.502920 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2886e88-e909-4b48-a135-508aaa5ba1ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.503427 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2886e88-e909-4b48-a135-508aaa5ba1ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.504331 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2886e88-e909-4b48-a135-508aaa5ba1ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.504984 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2886e88-e909-4b48-a135-508aaa5ba1ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.505428 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2886e88-e909-4b48-a135-508aaa5ba1ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.520787 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-a2886e88-e909-4b48-a135-508aaa5ba1ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] HTTP exception thrown: Instance 06bc19de-a634-49b9-b594-e66f5a07f584 could not be found. Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2886e88-e909-4b48-a135-508aaa5ba1ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Request method failure captured: Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 HTTP/1.1 Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZZwKfTj04T6UZy5whU5GnH06Qm2mjPMAvhRhYAf6YKOkKlLcdEUkYnhTcpRVF99d6zOw51Eu4MKu4qSCJA2DfrmeduSv2CPcOO2IOE6No0aJf0pyRwS9JPzSXJja0gkzZZ92NWtZdGv-AVZ4Zt9rvw5MPu-tY6pkTxKJ91Ococ8o8 Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: 1e42842c724f480f9cdd5ea75707b43f Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:11:14.522633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:11:14.525150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:11:14.525150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:11:14.525150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 1e42842c724f480f9cdd5ea75707b43f Sep 17 21:11:14.525150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:11:14.525150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-ServerRescueNegativeTestJSON-593011089-project Sep 17 21:11:14.525150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:11:14.525150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:11:14.525150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: a3dac44116784a9e963a69e4793bac4b Sep 17 21:11:14.525150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593011089-project Sep 17 21:11:14.525150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:11:14.525150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 06bc19de-a634-49b9-b594-e66f5a07f584 could not be found. Sep 17 21:11:14.525150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '06bc19de-a634-49b9-b594-e66f5a07f584'} Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06bc19de-a634-49b9-b594-e66f5a07f584 could not be found. Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:14.525896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06bc19de-a634-49b9-b594-e66f5a07f584 could not be found. Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06bc19de-a634-49b9-b594-e66f5a07f584 could not be found. Sep 17 21:11:14.527115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:14.528166 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2886e88-e909-4b48-a135-508aaa5ba1ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Returning 404 to user: Instance 06bc19de-a634-49b9-b594-e66f5a07f584 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:14.528166 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2886e88-e909-4b48-a135-508aaa5ba1ea tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584" status: 404 len: 111 microversion: 2.1 time: 0.034301 Sep 17 21:11:14.528166 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 363/738] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:14 2022] GET /compute/v2.1/servers/06bc19de-a634-49b9-b594-e66f5a07f584 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:11:14.534694 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a81de37-c241-4822-931e-a05dccc9339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:14.535276 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7a81de37-c241-4822-931e-a05dccc9339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:14.542278 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a81de37-c241-4822-931e-a05dccc9339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.542965 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a81de37-c241-4822-931e-a05dccc9339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.543401 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a81de37-c241-4822-931e-a05dccc9339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.544151 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a81de37-c241-4822-931e-a05dccc9339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.544823 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a81de37-c241-4822-931e-a05dccc9339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.545246 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a81de37-c241-4822-931e-a05dccc9339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.573715 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7a81de37-c241-4822-931e-a05dccc9339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:11:14.659246 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7a81de37-c241-4822-931e-a05dccc9339c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "DELETE /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 204 len: 0 microversion: 2.1 time: 0.127417 Sep 17 21:11:14.659809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 376/739] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:14 2022] DELETE /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:11:14.671771 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b5cd415-3d68-4743-b40b-0ec64c4da997 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:14.672647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9b5cd415-3d68-4743-b40b-0ec64c4da997 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:14.679738 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b5cd415-3d68-4743-b40b-0ec64c4da997 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.680623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b5cd415-3d68-4743-b40b-0ec64c4da997 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.681321 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b5cd415-3d68-4743-b40b-0ec64c4da997 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.682350 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b5cd415-3d68-4743-b40b-0ec64c4da997 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.683013 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b5cd415-3d68-4743-b40b-0ec64c4da997 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.683848 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b5cd415-3d68-4743-b40b-0ec64c4da997 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.723509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-234d88fe-3b50-44e2-9db9-c4c2c75fcfbd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:14.724487 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-234d88fe-3b50-44e2-9db9-c4c2c75fcfbd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:14.731738 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-234d88fe-3b50-44e2-9db9-c4c2c75fcfbd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.732238 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-234d88fe-3b50-44e2-9db9-c4c2c75fcfbd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.732688 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-234d88fe-3b50-44e2-9db9-c4c2c75fcfbd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.733418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-234d88fe-3b50-44e2-9db9-c4c2c75fcfbd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.733878 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-234d88fe-3b50-44e2-9db9-c4c2c75fcfbd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.734304 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-234d88fe-3b50-44e2-9db9-c4c2c75fcfbd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.868970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9b5cd415-3d68-4743-b40b-0ec64c4da997 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:14.877337 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9b5cd415-3d68-4743-b40b-0ec64c4da997 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1522 microversion: 2.1 time: 0.211086 Sep 17 21:11:14.878158 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 364/740] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:14 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:14.913496 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-234d88fe-3b50-44e2-9db9-c4c2c75fcfbd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:14.923352 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-234d88fe-3b50-44e2-9db9-c4c2c75fcfbd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.204438 Sep 17 21:11:14.923925 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 377/741] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:14 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:15.902067 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4f6db73c-cd62-48f8-a3e4-aef161650977 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:15.902749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4f6db73c-cd62-48f8-a3e4-aef161650977 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:15.909463 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f6db73c-cd62-48f8-a3e4-aef161650977 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:15.910092 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f6db73c-cd62-48f8-a3e4-aef161650977 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:15.910595 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f6db73c-cd62-48f8-a3e4-aef161650977 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:15.911356 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f6db73c-cd62-48f8-a3e4-aef161650977 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:15.911902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f6db73c-cd62-48f8-a3e4-aef161650977 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:15.912393 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f6db73c-cd62-48f8-a3e4-aef161650977 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:15.921408 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e6bce232-9d70-44a6-8bfc-0895aa8448df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:15.923744 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e6bce232-9d70-44a6-8bfc-0895aa8448df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:15.927267 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:15.931927 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6bce232-9d70-44a6-8bfc-0895aa8448df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:15.932430 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6bce232-9d70-44a6-8bfc-0895aa8448df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:15.932900 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6bce232-9d70-44a6-8bfc-0895aa8448df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:15.933615 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6bce232-9d70-44a6-8bfc-0895aa8448df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:15.934192 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6bce232-9d70-44a6-8bfc-0895aa8448df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:15.934626 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6bce232-9d70-44a6-8bfc-0895aa8448df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:15.967577 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e6bce232-9d70-44a6-8bfc-0895aa8448df tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049741 Sep 17 21:11:15.968145 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 378/742] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:11:15 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 17 21:11:15.975863 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-96ad8742-fdd5-4227-9c33-d0e35ff1dbdd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:15.977031 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-96ad8742-fdd5-4227-9c33-d0e35ff1dbdd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:15.983168 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96ad8742-fdd5-4227-9c33-d0e35ff1dbdd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:15.983725 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96ad8742-fdd5-4227-9c33-d0e35ff1dbdd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:15.984233 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96ad8742-fdd5-4227-9c33-d0e35ff1dbdd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:15.985046 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96ad8742-fdd5-4227-9c33-d0e35ff1dbdd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:15.985562 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96ad8742-fdd5-4227-9c33-d0e35ff1dbdd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:15.986090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96ad8742-fdd5-4227-9c33-d0e35ff1dbdd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:16.082403 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4f6db73c-cd62-48f8-a3e4-aef161650977 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:16.090863 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4f6db73c-cd62-48f8-a3e4-aef161650977 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1522 microversion: 2.1 time: 0.192693 Sep 17 21:11:16.091540 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 365/743] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:15 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:16.096146 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ad9ed65a-3775-4202-a662-9c723c9266d6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:16.096626 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ad9ed65a-3775-4202-a662-9c723c9266d6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:16.102890 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad9ed65a-3775-4202-a662-9c723c9266d6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:16.103385 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad9ed65a-3775-4202-a662-9c723c9266d6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:16.103858 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad9ed65a-3775-4202-a662-9c723c9266d6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:16.104562 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad9ed65a-3775-4202-a662-9c723c9266d6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:16.105055 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad9ed65a-3775-4202-a662-9c723c9266d6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:16.105508 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad9ed65a-3775-4202-a662-9c723c9266d6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:16.131112 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ad9ed65a-3775-4202-a662-9c723c9266d6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:11:16.148443 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-96ad8742-fdd5-4227-9c33-d0e35ff1dbdd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:16.157082 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-96ad8742-fdd5-4227-9c33-d0e35ff1dbdd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.184963 Sep 17 21:11:16.157732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 379/744] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:15 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:16.208117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ad9ed65a-3775-4202-a662-9c723c9266d6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 204 len: 0 microversion: 2.1 time: 0.115388 Sep 17 21:11:16.208912 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 366/745] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:16 2022] DELETE /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:11:16.216807 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4fd6f7bd-3b55-4264-a615-08b7bc8760a4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:16.217414 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4fd6f7bd-3b55-4264-a615-08b7bc8760a4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:16.223196 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fd6f7bd-3b55-4264-a615-08b7bc8760a4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:16.223669 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fd6f7bd-3b55-4264-a615-08b7bc8760a4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:16.224096 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fd6f7bd-3b55-4264-a615-08b7bc8760a4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:16.224921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fd6f7bd-3b55-4264-a615-08b7bc8760a4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:16.225416 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fd6f7bd-3b55-4264-a615-08b7bc8760a4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:16.225790 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fd6f7bd-3b55-4264-a615-08b7bc8760a4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:16.352903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4fd6f7bd-3b55-4264-a615-08b7bc8760a4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:16.360440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4fd6f7bd-3b55-4264-a615-08b7bc8760a4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1673 microversion: 2.1 time: 0.147491 Sep 17 21:11:16.361050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 380/746] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:16 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:17.114736 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cd3d6f3e-e698-4705-b3b5-fd386f97ef47 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:17.115356 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cd3d6f3e-e698-4705-b3b5-fd386f97ef47 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:17.122369 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd3d6f3e-e698-4705-b3b5-fd386f97ef47 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:17.122857 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd3d6f3e-e698-4705-b3b5-fd386f97ef47 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:17.123294 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd3d6f3e-e698-4705-b3b5-fd386f97ef47 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:17.123988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd3d6f3e-e698-4705-b3b5-fd386f97ef47 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:17.124490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd3d6f3e-e698-4705-b3b5-fd386f97ef47 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:17.124947 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd3d6f3e-e698-4705-b3b5-fd386f97ef47 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:17.182329 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-96b39734-b4b4-4c82-8fd8-7910aded415d tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:17.182952 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-96b39734-b4b4-4c82-8fd8-7910aded415d tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:17.189645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96b39734-b4b4-4c82-8fd8-7910aded415d tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:17.190133 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96b39734-b4b4-4c82-8fd8-7910aded415d tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:17.190573 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96b39734-b4b4-4c82-8fd8-7910aded415d tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:17.191277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96b39734-b4b4-4c82-8fd8-7910aded415d tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:17.191766 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96b39734-b4b4-4c82-8fd8-7910aded415d tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:17.192435 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96b39734-b4b4-4c82-8fd8-7910aded415d tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:17.296667 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cd3d6f3e-e698-4705-b3b5-fd386f97ef47 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:17.304447 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cd3d6f3e-e698-4705-b3b5-fd386f97ef47 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1522 microversion: 2.1 time: 0.193989 Sep 17 21:11:17.305642 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 367/747] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:17 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:17.342083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-96b39734-b4b4-4c82-8fd8-7910aded415d tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:17.349840 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-96b39734-b4b4-4c82-8fd8-7910aded415d tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.172332 Sep 17 21:11:17.350400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 381/748] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:17 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:17.383446 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25fd3962-4c30-4a36-9ddb-cb0d5be576b7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:17.383971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25fd3962-4c30-4a36-9ddb-cb0d5be576b7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:17.386328 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:11:17.386594 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Sat Sep 17 21:11:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 (ip 10.222.0.16) !!! Sep 17 21:11:17.393426 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25fd3962-4c30-4a36-9ddb-cb0d5be576b7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:17.393426 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25fd3962-4c30-4a36-9ddb-cb0d5be576b7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:17.393832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25fd3962-4c30-4a36-9ddb-cb0d5be576b7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:17.394536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25fd3962-4c30-4a36-9ddb-cb0d5be576b7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:17.394990 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25fd3962-4c30-4a36-9ddb-cb0d5be576b7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:17.395414 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25fd3962-4c30-4a36-9ddb-cb0d5be576b7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:17.526950 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-25fd3962-4c30-4a36-9ddb-cb0d5be576b7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:17.534743 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25fd3962-4c30-4a36-9ddb-cb0d5be576b7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1673 microversion: 2.1 time: 0.155235 Sep 17 21:11:17.535308 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 368/749] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:17 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:17.977687 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ed519b9f-b401-4feb-a349-facd0faa6502 req-d89f6871-e820-4ea4-b53a-2721a0b23f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19898312-d61b-457d-8217-d6c8e2ad2dbc", "name": "network-vif-deleted", "tag": "b2f701f8-a237-4a6e-9896-f63fd717b63e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:17.991046 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ed519b9f-b401-4feb-a349-facd0faa6502 req-d89f6871-e820-4ea4-b53a-2721a0b23f32 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:17.992474 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ed519b9f-b401-4feb-a349-facd0faa6502 req-d89f6871-e820-4ea4-b53a-2721a0b23f32 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:17.994171 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ed519b9f-b401-4feb-a349-facd0faa6502 req-d89f6871-e820-4ea4-b53a-2721a0b23f32 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.028210 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ed519b9f-b401-4feb-a349-facd0faa6502 req-d89f6871-e820-4ea4-b53a-2721a0b23f32 service nova] Creating event network-vif-deleted:b2f701f8-a237-4a6e-9896-f63fd717b63e for instance 19898312-d61b-457d-8217-d6c8e2ad2dbc on hv-cinder-82651 Sep 17 21:11:18.039192 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ed519b9f-b401-4feb-a349-facd0faa6502 req-d89f6871-e820-4ea4-b53a-2721a0b23f32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065452 Sep 17 21:11:18.040194 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 382/750] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:18.327803 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:18.328415 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:18.334632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.335315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.335916 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.336858 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.337309 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.338158 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.375282 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b93550d-76c4-4bea-80df-9fbc64a86c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:18.376204 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1b93550d-76c4-4bea-80df-9fbc64a86c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:18.377718 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.378244 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.378772 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.379561 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lazy-loading 'fault' on Instance uuid 19898312-d61b-457d-8217-d6c8e2ad2dbc {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:11:18.384966 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b93550d-76c4-4bea-80df-9fbc64a86c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.385445 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b93550d-76c4-4bea-80df-9fbc64a86c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.386123 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b93550d-76c4-4bea-80df-9fbc64a86c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.386973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b93550d-76c4-4bea-80df-9fbc64a86c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.387569 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b93550d-76c4-4bea-80df-9fbc64a86c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.388127 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b93550d-76c4-4bea-80df-9fbc64a86c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.407878 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:18.427538 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3dac44116784a9e963a69e4793bac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e42842c724f480f9cdd5ea75707b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:18.435607 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca65b5c9-b499-432a-95e7-2e44acec7e8c tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 200 len: 1312 microversion: 2.1 time: 0.111719 Sep 17 21:11:18.436397 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 369/751] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:18 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:18.559717 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13608ae0-8d08-4e4f-84a2-ab7265ce56f3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:18.560363 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-13608ae0-8d08-4e4f-84a2-ab7265ce56f3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:18.566653 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13608ae0-8d08-4e4f-84a2-ab7265ce56f3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.567653 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13608ae0-8d08-4e4f-84a2-ab7265ce56f3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.568084 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13608ae0-8d08-4e4f-84a2-ab7265ce56f3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.569047 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13608ae0-8d08-4e4f-84a2-ab7265ce56f3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.569578 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13608ae0-8d08-4e4f-84a2-ab7265ce56f3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.570002 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13608ae0-8d08-4e4f-84a2-ab7265ce56f3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.673199 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-13608ae0-8d08-4e4f-84a2-ab7265ce56f3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:18.678924 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1b93550d-76c4-4bea-80df-9fbc64a86c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:18.682054 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-13608ae0-8d08-4e4f-84a2-ab7265ce56f3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 200 len: 1605 microversion: 2.1 time: 0.127211 Sep 17 21:11:18.682923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 370/752] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:18 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 1605 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:18.686850 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b93550d-76c4-4bea-80df-9fbc64a86c4c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.316167 Sep 17 21:11:18.687416 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 383/753] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:18 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:18.860180 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-05dfc40d-ecc3-41e3-bed4-2d6b27638060 req-36dbf538-0e70-43a9-8488-1bcbb5f012bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b31e9e6-6a1c-44e8-bcdc-28130872f747", "name": "network-vif-deleted", "tag": "8904efef-a53d-4fef-b879-3abe2ae8a7c4"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:18.870522 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-05dfc40d-ecc3-41e3-bed4-2d6b27638060 req-36dbf538-0e70-43a9-8488-1bcbb5f012bd service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.871012 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-05dfc40d-ecc3-41e3-bed4-2d6b27638060 req-36dbf538-0e70-43a9-8488-1bcbb5f012bd service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.871473 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-05dfc40d-ecc3-41e3-bed4-2d6b27638060 req-36dbf538-0e70-43a9-8488-1bcbb5f012bd service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.888066 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-05dfc40d-ecc3-41e3-bed4-2d6b27638060 req-36dbf538-0e70-43a9-8488-1bcbb5f012bd service nova] Creating event network-vif-deleted:8904efef-a53d-4fef-b879-3abe2ae8a7c4 for instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 on hv-cinder-82651 Sep 17 21:11:18.894361 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-05dfc40d-ecc3-41e3-bed4-2d6b27638060 req-36dbf538-0e70-43a9-8488-1bcbb5f012bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041940 Sep 17 21:11:18.894966 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 371/754] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:19.460062 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c83f4a6-52bd-497d-bacd-577f12f56787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:19.461681 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3c83f4a6-52bd-497d-bacd-577f12f56787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] [instance: 19898312-d61b-457d-8217-d6c8e2ad2dbc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:19.468236 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c83f4a6-52bd-497d-bacd-577f12f56787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.468741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c83f4a6-52bd-497d-bacd-577f12f56787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.469387 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c83f4a6-52bd-497d-bacd-577f12f56787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.470511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c83f4a6-52bd-497d-bacd-577f12f56787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.471133 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c83f4a6-52bd-497d-bacd-577f12f56787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.471994 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c83f4a6-52bd-497d-bacd-577f12f56787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.486877 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-3c83f4a6-52bd-497d-bacd-577f12f56787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] HTTP exception thrown: Instance 19898312-d61b-457d-8217-d6c8e2ad2dbc could not be found. Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c83f4a6-52bd-497d-bacd-577f12f56787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Request method failure captured: Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc HTTP/1.1 Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZZwKfTj04T6UZy5whU5GnH06Qm2mjPMAvhRhYAf6YKOkKlLcdEUkYnhTcpRVF99d6zOw51Eu4MKu4qSCJA2DfrmeduSv2CPcOO2IOE6No0aJf0pyRwS9JPzSXJja0gkzZZ92NWtZdGv-AVZ4Zt9rvw5MPu-tY6pkTxKJ91Ococ8o8 Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: 1e42842c724f480f9cdd5ea75707b43f Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:11:19.489620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:11:19.490947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1e42842c724f480f9cdd5ea75707b43f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:11:19.490947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:11:19.490947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 1e42842c724f480f9cdd5ea75707b43f Sep 17 21:11:19.490947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593011089 Sep 17 21:11:19.490947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-ServerRescueNegativeTestJSON-593011089-project Sep 17 21:11:19.490947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:11:19.490947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:11:19.490947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: a3dac44116784a9e963a69e4793bac4b Sep 17 21:11:19.490947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593011089-project Sep 17 21:11:19.490947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:11:19.490947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 19898312-d61b-457d-8217-d6c8e2ad2dbc could not be found. Sep 17 21:11:19.490947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '19898312-d61b-457d-8217-d6c8e2ad2dbc'} Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19898312-d61b-457d-8217-d6c8e2ad2dbc could not be found. Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:19.491818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19898312-d61b-457d-8217-d6c8e2ad2dbc could not be found. Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19898312-d61b-457d-8217-d6c8e2ad2dbc could not be found. Sep 17 21:11:19.493475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:11:19.494539 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c83f4a6-52bd-497d-bacd-577f12f56787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] Returning 404 to user: Instance 19898312-d61b-457d-8217-d6c8e2ad2dbc could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:19.494539 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3c83f4a6-52bd-497d-bacd-577f12f56787 tempest-ServerRescueNegativeTestJSON-593011089 tempest-ServerRescueNegativeTestJSON-593011089-project] 10.222.0.16 "GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc" status: 404 len: 111 microversion: 2.1 time: 0.036043 Sep 17 21:11:19.494539 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 384/755] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:19 2022] GET /compute/v2.1/servers/19898312-d61b-457d-8217-d6c8e2ad2dbc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:11:19.707306 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33dc9ac6-aa2f-4633-87f6-5e6d9992afa0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:19.708006 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-33dc9ac6-aa2f-4633-87f6-5e6d9992afa0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:19.712411 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9c631ec-f79c-4d4d-ba4e-3143d944f2ab tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:19.712852 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9c631ec-f79c-4d4d-ba4e-3143d944f2ab tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:19.715909 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33dc9ac6-aa2f-4633-87f6-5e6d9992afa0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.716385 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33dc9ac6-aa2f-4633-87f6-5e6d9992afa0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.717307 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33dc9ac6-aa2f-4633-87f6-5e6d9992afa0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.718338 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33dc9ac6-aa2f-4633-87f6-5e6d9992afa0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.718947 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33dc9ac6-aa2f-4633-87f6-5e6d9992afa0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.719061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c631ec-f79c-4d4d-ba4e-3143d944f2ab tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.719477 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c631ec-f79c-4d4d-ba4e-3143d944f2ab tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.719792 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33dc9ac6-aa2f-4633-87f6-5e6d9992afa0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.719939 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c631ec-f79c-4d4d-ba4e-3143d944f2ab tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.720627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c631ec-f79c-4d4d-ba4e-3143d944f2ab tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.721147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c631ec-f79c-4d4d-ba4e-3143d944f2ab tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.721581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c631ec-f79c-4d4d-ba4e-3143d944f2ab tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.735425 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-33dc9ac6-aa2f-4633-87f6-5e6d9992afa0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] HTTP exception thrown: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33dc9ac6-aa2f-4633-87f6-5e6d9992afa0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Request method failure captured: Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 HTTP/1.1 Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZdobnJlAYXfZpHtDmHGZcwMqCN44aDair10sFGHblIDg45v-i-tGl0WQpq7KmHbxM8Dfpp4n5jBl6WFGL-d4YWmngCF8HWtFZA63GzYJAYXl0gXTMOikdnejMoDzQD2UTDa7ez7pEUPvzMOI2-cMyu83-bg9u8AQwXTlT74Kty4yw Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: aae15e7cf5d74f9f90e067bb801c7e95 Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:11:19.737431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:11:19.739016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:11:19.739016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:11:19.739016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: aae15e7cf5d74f9f90e067bb801c7e95 Sep 17 21:11:19.739016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:11:19.739016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeTestJSON-402069048-project Sep 17 21:11:19.739016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:11:19.739016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:11:19.739016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 4b5e98fb43a143ea8cfa30990b4fffc2 Sep 17 21:11:19.739016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeTestJSON-402069048-project Sep 17 21:11:19.739016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:11:19.739016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:11:19.739016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '2b31e9e6-6a1c-44e8-bcdc-28130872f747'} Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:19.739902 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:11:19.741325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:11:19.743391 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33dc9ac6-aa2f-4633-87f6-5e6d9992afa0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Returning 404 to user: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:19.744387 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33dc9ac6-aa2f-4633-87f6-5e6d9992afa0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 404 len: 111 microversion: 2.1 time: 0.041553 Sep 17 21:11:19.745313 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 372/756] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:19 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:11:19.753647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d878e92d-cfef-4a47-950e-7628d6f92467 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '.version_select at 0x7f9baad364c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:19.777714 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d878e92d-cfef-4a47-950e-7628d6f92467 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014573676" status: 202 len: 0 microversion: 2.1 time: 0.025811 Sep 17 21:11:19.781465 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 373/757] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 17 21:11:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014573676 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:11:19.947391 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9c631ec-f79c-4d4d-ba4e-3143d944f2ab tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:19.955803 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9c631ec-f79c-4d4d-ba4e-3143d944f2ab tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.248307 Sep 17 21:11:19.957794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 385/758] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:19 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:20.457420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09fa7f11-80e2-4060-a6c3-f3b6fcce06d7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Action: 'create', calling method: .version_select at 0x7f9baacce820>, body: {"keypair": {"name": "tempest-keypair-1463632855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpEFIZ2yAoBVS3F+LJxel5ELn1+2RsvCxwZmIa7BoQV10NLI1GpwTKAKtj8yYIrurUjnIog8Z0GvIsywxxM08LC7dJaphW3qjWz61URq4nYpPKzTpv/EeHDhgqyONceNw=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:20.468142 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:20.476358 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-09fa7f11-80e2-4060-a6c3-f3b6fcce06d7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Getting quotas for project aae15e7cf5d74f9f90e067bb801c7e95. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:11:20.481378 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-09fa7f11-80e2-4060-a6c3-f3b6fcce06d7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Getting quotas for user 4b5e98fb43a143ea8cfa30990b4fffc2 and project aae15e7cf5d74f9f90e067bb801c7e95. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:11:20.505070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09fa7f11-80e2-4060-a6c3-f3b6fcce06d7 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051550 Sep 17 21:11:20.505663 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 374/759] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 17 21:11:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:20.981294 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34fff72a-e761-4635-a91f-4621e7aba8e2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:20.982497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34fff72a-e761-4635-a91f-4621e7aba8e2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:20.989319 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fff72a-e761-4635-a91f-4621e7aba8e2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:20.990186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fff72a-e761-4635-a91f-4621e7aba8e2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:20.990850 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fff72a-e761-4635-a91f-4621e7aba8e2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:20.992045 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fff72a-e761-4635-a91f-4621e7aba8e2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:20.992650 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fff72a-e761-4635-a91f-4621e7aba8e2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:20.993457 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fff72a-e761-4635-a91f-4621e7aba8e2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:21.354963 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-34fff72a-e761-4635-a91f-4621e7aba8e2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:21.363264 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34fff72a-e761-4635-a91f-4621e7aba8e2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.385863 Sep 17 21:11:21.363788 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 386/760] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:20 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:22.049932 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-884705830", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9c2d47c-0edd-4dba-a1db-ebe7dbfe9437"}], "security_groups": [{"name": "tempest-securitygroup--200292139"}], "key_name": "tempest-keypair-1463632855", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:22.252315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] validate_networks() for [('c9c2d47c-0edd-4dba-a1db-ebe7dbfe9437', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:11:22.387901 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d162d567-d16a-47e7-90a2-b0dd8df54be5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:22.389287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d162d567-d16a-47e7-90a2-b0dd8df54be5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:22.397394 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d162d567-d16a-47e7-90a2-b0dd8df54be5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.398732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d162d567-d16a-47e7-90a2-b0dd8df54be5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.399293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d162d567-d16a-47e7-90a2-b0dd8df54be5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.400048 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d162d567-d16a-47e7-90a2-b0dd8df54be5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.400508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d162d567-d16a-47e7-90a2-b0dd8df54be5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.401252 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d162d567-d16a-47e7-90a2-b0dd8df54be5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.704521 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d162d567-d16a-47e7-90a2-b0dd8df54be5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:22.714704 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d162d567-d16a-47e7-90a2-b0dd8df54be5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.331125 Sep 17 21:11:22.715829 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 387/761] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:22 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:22.940618 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:11:22.948011 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:11:22.948748 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:11:22.949401 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:11:22.949893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:11:22.959035 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.959515 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.959945 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.961185 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.961821 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.962340 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.969025 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:22.981873 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Getting quotas for project aae15e7cf5d74f9f90e067bb801c7e95. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:11:22.986485 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Getting quotas for user 4b5e98fb43a143ea8cfa30990b4fffc2 and project aae15e7cf5d74f9f90e067bb801c7e95. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:11:22.998282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:11:23.000587 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:11:23.062223 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6de6d116-b23c-4232-8b61-e539376496e3 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.017859 Sep 17 21:11:23.063304 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 375/762] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:11:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:11:23.074664 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-77b8b3d3-86bf-4c5d-90ed-9bf26cf8ab06 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:23.078372 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-77b8b3d3-86bf-4c5d-90ed-9bf26cf8ab06 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:23.149499 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-77b8b3d3-86bf-4c5d-90ed-9bf26cf8ab06 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:23.159683 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-77b8b3d3-86bf-4c5d-90ed-9bf26cf8ab06 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1237 microversion: 2.1 time: 0.088054 Sep 17 21:11:23.160907 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 388/763] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:23 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:23.743332 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-360c5d12-14ee-43ae-bfdf-7fe829bde9c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:23.744263 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-360c5d12-14ee-43ae-bfdf-7fe829bde9c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:23.752116 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-360c5d12-14ee-43ae-bfdf-7fe829bde9c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:23.752612 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-360c5d12-14ee-43ae-bfdf-7fe829bde9c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:23.753091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-360c5d12-14ee-43ae-bfdf-7fe829bde9c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:23.753800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-360c5d12-14ee-43ae-bfdf-7fe829bde9c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:23.754258 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-360c5d12-14ee-43ae-bfdf-7fe829bde9c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:23.754681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-360c5d12-14ee-43ae-bfdf-7fe829bde9c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:23.897565 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-360c5d12-14ee-43ae-bfdf-7fe829bde9c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:23.908368 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-360c5d12-14ee-43ae-bfdf-7fe829bde9c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.170358 Sep 17 21:11:23.909133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 376/764] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:23 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:24.184494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06c2186b-4692-4328-8ff1-3d6a2bbd0dea tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:24.185181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-06c2186b-4692-4328-8ff1-3d6a2bbd0dea tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:24.192013 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06c2186b-4692-4328-8ff1-3d6a2bbd0dea tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:24.192834 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06c2186b-4692-4328-8ff1-3d6a2bbd0dea tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:24.193274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06c2186b-4692-4328-8ff1-3d6a2bbd0dea tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:24.194108 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06c2186b-4692-4328-8ff1-3d6a2bbd0dea tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:24.194569 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06c2186b-4692-4328-8ff1-3d6a2bbd0dea tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:24.195136 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06c2186b-4692-4328-8ff1-3d6a2bbd0dea tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:24.256989 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-06c2186b-4692-4328-8ff1-3d6a2bbd0dea tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:24.264839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-06c2186b-4692-4328-8ff1-3d6a2bbd0dea tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1233 microversion: 2.1 time: 0.084207 Sep 17 21:11:24.265406 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 389/765] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:24 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:24.932377 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9944b3ea-656f-4d09-803c-6fd0b0c445cd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:24.933137 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9944b3ea-656f-4d09-803c-6fd0b0c445cd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:24.940586 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9944b3ea-656f-4d09-803c-6fd0b0c445cd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:24.941110 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9944b3ea-656f-4d09-803c-6fd0b0c445cd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:24.941547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9944b3ea-656f-4d09-803c-6fd0b0c445cd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:24.942509 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9944b3ea-656f-4d09-803c-6fd0b0c445cd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:24.942966 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9944b3ea-656f-4d09-803c-6fd0b0c445cd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:24.943768 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9944b3ea-656f-4d09-803c-6fd0b0c445cd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:25.089652 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9944b3ea-656f-4d09-803c-6fd0b0c445cd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:25.100698 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9944b3ea-656f-4d09-803c-6fd0b0c445cd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1568 microversion: 2.1 time: 0.173071 Sep 17 21:11:25.101639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 377/766] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:24 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:25.124834 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76dd0619-9881-4df9-924d-56d5e2285406 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:25.125453 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76dd0619-9881-4df9-924d-56d5e2285406 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:25.131622 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76dd0619-9881-4df9-924d-56d5e2285406 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:25.132209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76dd0619-9881-4df9-924d-56d5e2285406 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:25.133240 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76dd0619-9881-4df9-924d-56d5e2285406 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:25.133949 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76dd0619-9881-4df9-924d-56d5e2285406 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:25.134413 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76dd0619-9881-4df9-924d-56d5e2285406 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:25.134843 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76dd0619-9881-4df9-924d-56d5e2285406 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:25.165803 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76dd0619-9881-4df9-924d-56d5e2285406 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120587) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 17 21:11:25.245600 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76dd0619-9881-4df9-924d-56d5e2285406 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "POST /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7/action" status: 202 len: 0 microversion: 2.1 time: 0.124657 Sep 17 21:11:25.247402 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 390/767] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:11:25 2022] POST /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:11:25.255620 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b3efbdc8-7ae9-4517-8ecb-9c0a06976210 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:25.256474 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b3efbdc8-7ae9-4517-8ecb-9c0a06976210 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:25.265061 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3efbdc8-7ae9-4517-8ecb-9c0a06976210 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:25.265795 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3efbdc8-7ae9-4517-8ecb-9c0a06976210 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:25.266285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3efbdc8-7ae9-4517-8ecb-9c0a06976210 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:25.266954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3efbdc8-7ae9-4517-8ecb-9c0a06976210 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:25.267403 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3efbdc8-7ae9-4517-8ecb-9c0a06976210 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:25.267822 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3efbdc8-7ae9-4517-8ecb-9c0a06976210 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:25.287867 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-770959c4-71de-4aff-a7d1-acd03fa0c390 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:25.289400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-770959c4-71de-4aff-a7d1-acd03fa0c390 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:25.312882 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-770959c4-71de-4aff-a7d1-acd03fa0c390 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:25.313405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-770959c4-71de-4aff-a7d1-acd03fa0c390 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:25.313844 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-770959c4-71de-4aff-a7d1-acd03fa0c390 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:25.325974 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-770959c4-71de-4aff-a7d1-acd03fa0c390 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:25.326725 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-770959c4-71de-4aff-a7d1-acd03fa0c390 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:25.328221 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-770959c4-71de-4aff-a7d1-acd03fa0c390 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:25.510023 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-770959c4-71de-4aff-a7d1-acd03fa0c390 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:25.519976 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-770959c4-71de-4aff-a7d1-acd03fa0c390 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1297 microversion: 2.1 time: 0.236275 Sep 17 21:11:25.520559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 391/768] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:25 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1297 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:25.625623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b3efbdc8-7ae9-4517-8ecb-9c0a06976210 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:25.634141 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b3efbdc8-7ae9-4517-8ecb-9c0a06976210 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1576 microversion: 2.1 time: 0.382509 Sep 17 21:11:25.634790 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 378/769] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:25 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1576 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:26.547578 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-481dee19-dc88-4f6d-b1a1-a692d4ece5de tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:26.548262 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-481dee19-dc88-4f6d-b1a1-a692d4ece5de tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:26.556058 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-481dee19-dc88-4f6d-b1a1-a692d4ece5de tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:26.556812 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-481dee19-dc88-4f6d-b1a1-a692d4ece5de tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:26.558605 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-481dee19-dc88-4f6d-b1a1-a692d4ece5de tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:26.560423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-481dee19-dc88-4f6d-b1a1-a692d4ece5de tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:26.561932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-481dee19-dc88-4f6d-b1a1-a692d4ece5de tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:26.562697 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-481dee19-dc88-4f6d-b1a1-a692d4ece5de tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:26.662138 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f01c2063-0280-48b5-88ce-18b5b35c9982 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:26.663516 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f01c2063-0280-48b5-88ce-18b5b35c9982 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:26.671825 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f01c2063-0280-48b5-88ce-18b5b35c9982 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:26.672531 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f01c2063-0280-48b5-88ce-18b5b35c9982 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:26.673143 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f01c2063-0280-48b5-88ce-18b5b35c9982 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:26.674016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f01c2063-0280-48b5-88ce-18b5b35c9982 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:26.674680 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f01c2063-0280-48b5-88ce-18b5b35c9982 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:26.675109 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f01c2063-0280-48b5-88ce-18b5b35c9982 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:27.178664 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-481dee19-dc88-4f6d-b1a1-a692d4ece5de tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:27.186671 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-481dee19-dc88-4f6d-b1a1-a692d4ece5de tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1362 microversion: 2.1 time: 0.643313 Sep 17 21:11:27.187168 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 392/770] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:26 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1362 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:27.192015 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-77ebe823-083b-409d-931e-68b261f94d7b req-39b9082a-d7e8-4402-9ff0-ab45a6825fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3209ceff-722f-437e-9ece-3f9542c1daa7", "name": "network-vif-unplugged", "status": "completed", "tag": "9ec72a7a-4fab-4ddb-9a94-b4581d132104"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:27.204195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-77ebe823-083b-409d-931e-68b261f94d7b req-39b9082a-d7e8-4402-9ff0-ab45a6825fbe service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:27.205037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-77ebe823-083b-409d-931e-68b261f94d7b req-39b9082a-d7e8-4402-9ff0-ab45a6825fbe service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:27.205682 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-77ebe823-083b-409d-931e-68b261f94d7b req-39b9082a-d7e8-4402-9ff0-ab45a6825fbe service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:27.219154 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-77ebe823-083b-409d-931e-68b261f94d7b req-39b9082a-d7e8-4402-9ff0-ab45a6825fbe service nova] Creating event network-vif-unplugged:9ec72a7a-4fab-4ddb-9a94-b4581d132104 for instance 3209ceff-722f-437e-9ece-3f9542c1daa7 on hv-cinder-82651 Sep 17 21:11:27.229202 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-77ebe823-083b-409d-931e-68b261f94d7b req-39b9082a-d7e8-4402-9ff0-ab45a6825fbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040499 Sep 17 21:11:27.230465 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 393/771] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:27.240369 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f01c2063-0280-48b5-88ce-18b5b35c9982 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:27.250044 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f01c2063-0280-48b5-88ce-18b5b35c9982 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1574 microversion: 2.1 time: 0.596254 Sep 17 21:11:27.250712 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 379/772] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:26 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1574 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:27.779460 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-4e46a6b7-7946-4fa8-a1fe-301fbd545612 req-cceda5f9-38c0-459c-9b17-bb5ee8c612e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2de9d30-c24d-41d2-bbdf-79429561d8d6", "tag": "8bdcaef8-e19b-4b96-847b-f6bbb29f455b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:27.791638 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4e46a6b7-7946-4fa8-a1fe-301fbd545612 req-cceda5f9-38c0-459c-9b17-bb5ee8c612e9 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:27.792226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4e46a6b7-7946-4fa8-a1fe-301fbd545612 req-cceda5f9-38c0-459c-9b17-bb5ee8c612e9 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:27.792748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4e46a6b7-7946-4fa8-a1fe-301fbd545612 req-cceda5f9-38c0-459c-9b17-bb5ee8c612e9 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:27.806223 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-4e46a6b7-7946-4fa8-a1fe-301fbd545612 req-cceda5f9-38c0-459c-9b17-bb5ee8c612e9 service nova] Creating event network-changed:8bdcaef8-e19b-4b96-847b-f6bbb29f455b for instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 on hv-cinder-82651 Sep 17 21:11:27.812954 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-4e46a6b7-7946-4fa8-a1fe-301fbd545612 req-cceda5f9-38c0-459c-9b17-bb5ee8c612e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037053 Sep 17 21:11:27.814010 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 394/773] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:28.213616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-091fe77c-ad2c-4162-9eb4-df0709ba4e88 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:28.214417 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-091fe77c-ad2c-4162-9eb4-df0709ba4e88 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:28.220903 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-091fe77c-ad2c-4162-9eb4-df0709ba4e88 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:28.221325 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-091fe77c-ad2c-4162-9eb4-df0709ba4e88 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:28.221758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-091fe77c-ad2c-4162-9eb4-df0709ba4e88 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:28.222448 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-091fe77c-ad2c-4162-9eb4-df0709ba4e88 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:28.222901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-091fe77c-ad2c-4162-9eb4-df0709ba4e88 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:28.223320 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-091fe77c-ad2c-4162-9eb4-df0709ba4e88 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:28.277254 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-683e1c45-9ee7-4cfe-b8b6-28f136e6d2aa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:28.277988 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-683e1c45-9ee7-4cfe-b8b6-28f136e6d2aa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:28.284195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-683e1c45-9ee7-4cfe-b8b6-28f136e6d2aa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:28.284707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-683e1c45-9ee7-4cfe-b8b6-28f136e6d2aa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:28.285156 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-683e1c45-9ee7-4cfe-b8b6-28f136e6d2aa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:28.285896 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-683e1c45-9ee7-4cfe-b8b6-28f136e6d2aa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:28.286360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-683e1c45-9ee7-4cfe-b8b6-28f136e6d2aa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:28.286989 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-683e1c45-9ee7-4cfe-b8b6-28f136e6d2aa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:28.403860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-091fe77c-ad2c-4162-9eb4-df0709ba4e88 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:28.413323 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-091fe77c-ad2c-4162-9eb4-df0709ba4e88 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1362 microversion: 2.1 time: 0.204048 Sep 17 21:11:28.428952 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 380/774] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:28 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:28.461797 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-683e1c45-9ee7-4cfe-b8b6-28f136e6d2aa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:28.470034 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-683e1c45-9ee7-4cfe-b8b6-28f136e6d2aa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1574 microversion: 2.1 time: 0.199010 Sep 17 21:11:28.470627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 395/775] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:28 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:29.437104 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c46ee6e1-19da-40d7-afa2-2d98cc2cf1f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:29.437712 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c46ee6e1-19da-40d7-afa2-2d98cc2cf1f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:29.444478 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c46ee6e1-19da-40d7-afa2-2d98cc2cf1f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:29.445182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c46ee6e1-19da-40d7-afa2-2d98cc2cf1f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:29.445698 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c46ee6e1-19da-40d7-afa2-2d98cc2cf1f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:29.446386 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c46ee6e1-19da-40d7-afa2-2d98cc2cf1f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:29.446836 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c46ee6e1-19da-40d7-afa2-2d98cc2cf1f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:29.447253 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c46ee6e1-19da-40d7-afa2-2d98cc2cf1f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:29.494248 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f3960f1c-7489-4216-b6da-bd8ffbd75ab1 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:29.494853 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f3960f1c-7489-4216-b6da-bd8ffbd75ab1 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:29.501484 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3960f1c-7489-4216-b6da-bd8ffbd75ab1 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:29.502170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3960f1c-7489-4216-b6da-bd8ffbd75ab1 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:29.502601 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3960f1c-7489-4216-b6da-bd8ffbd75ab1 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:29.503294 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3960f1c-7489-4216-b6da-bd8ffbd75ab1 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:29.503741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3960f1c-7489-4216-b6da-bd8ffbd75ab1 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:29.504158 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3960f1c-7489-4216-b6da-bd8ffbd75ab1 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:29.620146 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c46ee6e1-19da-40d7-afa2-2d98cc2cf1f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:29.628002 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c46ee6e1-19da-40d7-afa2-2d98cc2cf1f4 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1362 microversion: 2.1 time: 0.194580 Sep 17 21:11:29.628565 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 381/776] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:29 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:29.668001 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f3960f1c-7489-4216-b6da-bd8ffbd75ab1 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:29.676085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f3960f1c-7489-4216-b6da-bd8ffbd75ab1 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1574 microversion: 2.1 time: 0.186252 Sep 17 21:11:29.676643 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 396/777] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:29 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:30.651532 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-debfec2f-705b-4966-b326-d7bea8c32624 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:30.652086 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-debfec2f-705b-4966-b326-d7bea8c32624 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:30.658486 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-debfec2f-705b-4966-b326-d7bea8c32624 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:30.658960 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-debfec2f-705b-4966-b326-d7bea8c32624 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:30.659386 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-debfec2f-705b-4966-b326-d7bea8c32624 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:30.660063 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-debfec2f-705b-4966-b326-d7bea8c32624 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:30.660510 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-debfec2f-705b-4966-b326-d7bea8c32624 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:30.661017 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-debfec2f-705b-4966-b326-d7bea8c32624 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:30.701235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a9d19a5e-9a69-41bf-ac36-8c6ba16c3ef6 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:30.701843 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a9d19a5e-9a69-41bf-ac36-8c6ba16c3ef6 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:30.708225 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9d19a5e-9a69-41bf-ac36-8c6ba16c3ef6 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:30.708742 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9d19a5e-9a69-41bf-ac36-8c6ba16c3ef6 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:30.709181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9d19a5e-9a69-41bf-ac36-8c6ba16c3ef6 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:30.709879 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9d19a5e-9a69-41bf-ac36-8c6ba16c3ef6 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:30.711034 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9d19a5e-9a69-41bf-ac36-8c6ba16c3ef6 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:30.711544 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9d19a5e-9a69-41bf-ac36-8c6ba16c3ef6 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:30.831632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-debfec2f-705b-4966-b326-d7bea8c32624 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:30.841078 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-debfec2f-705b-4966-b326-d7bea8c32624 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1362 microversion: 2.1 time: 0.194275 Sep 17 21:11:30.842961 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 382/778] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:30 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:30.880765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a9d19a5e-9a69-41bf-ac36-8c6ba16c3ef6 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:30.889553 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a9d19a5e-9a69-41bf-ac36-8c6ba16c3ef6 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1574 microversion: 2.1 time: 0.192109 Sep 17 21:11:30.890307 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 397/779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:30 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:31.863742 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5acddcaa-c3e7-44f1-ba55-d254e6b258ec tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:31.864351 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5acddcaa-c3e7-44f1-ba55-d254e6b258ec tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:31.871259 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5acddcaa-c3e7-44f1-ba55-d254e6b258ec tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:31.871743 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5acddcaa-c3e7-44f1-ba55-d254e6b258ec tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:31.872174 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5acddcaa-c3e7-44f1-ba55-d254e6b258ec tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:31.872891 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5acddcaa-c3e7-44f1-ba55-d254e6b258ec tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:31.873346 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5acddcaa-c3e7-44f1-ba55-d254e6b258ec tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:31.873806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5acddcaa-c3e7-44f1-ba55-d254e6b258ec tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:31.912629 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0c1880a9-234a-49fa-b974-843e0e280e0b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:31.913310 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0c1880a9-234a-49fa-b974-843e0e280e0b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:31.920011 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c1880a9-234a-49fa-b974-843e0e280e0b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:31.920490 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c1880a9-234a-49fa-b974-843e0e280e0b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:31.920945 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c1880a9-234a-49fa-b974-843e0e280e0b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:31.921646 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c1880a9-234a-49fa-b974-843e0e280e0b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:31.922116 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c1880a9-234a-49fa-b974-843e0e280e0b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:31.922583 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c1880a9-234a-49fa-b974-843e0e280e0b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:32.055969 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5acddcaa-c3e7-44f1-ba55-d254e6b258ec tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:32.063589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5acddcaa-c3e7-44f1-ba55-d254e6b258ec tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1362 microversion: 2.1 time: 0.203681 Sep 17 21:11:32.064141 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 383/780] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:31 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:32.083509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c1880a9-234a-49fa-b974-843e0e280e0b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:32.091894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0c1880a9-234a-49fa-b974-843e0e280e0b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1574 microversion: 2.1 time: 0.183146 Sep 17 21:11:32.092396 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 398/781] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:31 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:33.029326 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-65e1b578-d79c-4e55-bbca-60944da7978a req-cfa0ed11-018e-4d90-a347-efb726d26a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2de9d30-c24d-41d2-bbdf-79429561d8d6", "name": "network-vif-plugged", "status": "completed", "tag": "8bdcaef8-e19b-4b96-847b-f6bbb29f455b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:33.034957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:33.035793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:33.042524 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-65e1b578-d79c-4e55-bbca-60944da7978a req-cfa0ed11-018e-4d90-a347-efb726d26a37 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:33.042888 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-65e1b578-d79c-4e55-bbca-60944da7978a req-cfa0ed11-018e-4d90-a347-efb726d26a37 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:33.043309 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-65e1b578-d79c-4e55-bbca-60944da7978a req-cfa0ed11-018e-4d90-a347-efb726d26a37 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:33.055922 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-65e1b578-d79c-4e55-bbca-60944da7978a req-cfa0ed11-018e-4d90-a347-efb726d26a37 service nova] Creating event network-vif-plugged:8bdcaef8-e19b-4b96-847b-f6bbb29f455b for instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 on hv-cinder-82651 Sep 17 21:11:33.062026 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-65e1b578-d79c-4e55-bbca-60944da7978a req-cfa0ed11-018e-4d90-a347-efb726d26a37 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036317 Sep 17 21:11:33.062955 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 384/782] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:33.086749 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4e3129e-6f35-4c6c-a5f9-a7121ace677a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:33.087359 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4e3129e-6f35-4c6c-a5f9-a7121ace677a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:33.095044 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4e3129e-6f35-4c6c-a5f9-a7121ace677a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:33.095711 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4e3129e-6f35-4c6c-a5f9-a7121ace677a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:33.096311 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4e3129e-6f35-4c6c-a5f9-a7121ace677a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:33.103797 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4e3129e-6f35-4c6c-a5f9-a7121ace677a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:33.104330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4e3129e-6f35-4c6c-a5f9-a7121ace677a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:33.105286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4e3129e-6f35-4c6c-a5f9-a7121ace677a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:33.118025 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fa3531e2-4e99-4429-b031-984fdabf8d89 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:33.118734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fa3531e2-4e99-4429-b031-984fdabf8d89 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:33.130755 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3531e2-4e99-4429-b031-984fdabf8d89 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:33.133041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3531e2-4e99-4429-b031-984fdabf8d89 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:33.134047 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3531e2-4e99-4429-b031-984fdabf8d89 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:33.135079 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3531e2-4e99-4429-b031-984fdabf8d89 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:33.135942 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3531e2-4e99-4429-b031-984fdabf8d89 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:33.136836 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3531e2-4e99-4429-b031-984fdabf8d89 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:33.155921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:33.431181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4e3129e-6f35-4c6c-a5f9-a7121ace677a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:33.439038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4e3129e-6f35-4c6c-a5f9-a7121ace677a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1362 microversion: 2.1 time: 0.356647 Sep 17 21:11:33.439696 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 399/783] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:33 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:33.453790 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fa3531e2-4e99-4429-b031-984fdabf8d89 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:33.464629 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fa3531e2-4e99-4429-b031-984fdabf8d89 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1574 microversion: 2.1 time: 0.351437 Sep 17 21:11:33.465412 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 385/784] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:33 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1574 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:34.462520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b078034-1fe9-4ba4-ad2d-86f230c29811 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:34.463293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b078034-1fe9-4ba4-ad2d-86f230c29811 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:34.469578 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b078034-1fe9-4ba4-ad2d-86f230c29811 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:34.470052 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b078034-1fe9-4ba4-ad2d-86f230c29811 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:34.470480 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b078034-1fe9-4ba4-ad2d-86f230c29811 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:34.471323 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b078034-1fe9-4ba4-ad2d-86f230c29811 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:34.471641 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b078034-1fe9-4ba4-ad2d-86f230c29811 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:34.472061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b078034-1fe9-4ba4-ad2d-86f230c29811 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:34.491265 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c335b41-45b9-47ae-9f09-45be28a6bf2e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:34.492045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c335b41-45b9-47ae-9f09-45be28a6bf2e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:34.499167 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c335b41-45b9-47ae-9f09-45be28a6bf2e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:34.499651 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c335b41-45b9-47ae-9f09-45be28a6bf2e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:34.500079 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c335b41-45b9-47ae-9f09-45be28a6bf2e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:34.500802 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c335b41-45b9-47ae-9f09-45be28a6bf2e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:34.501382 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c335b41-45b9-47ae-9f09-45be28a6bf2e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:34.501802 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c335b41-45b9-47ae-9f09-45be28a6bf2e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:34.664464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b078034-1fe9-4ba4-ad2d-86f230c29811 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:34.672466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b078034-1fe9-4ba4-ad2d-86f230c29811 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1362 microversion: 2.1 time: 0.214262 Sep 17 21:11:34.674659 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 400/785] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:34 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:34.698948 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c335b41-45b9-47ae-9f09-45be28a6bf2e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:34.706806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c335b41-45b9-47ae-9f09-45be28a6bf2e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1574 microversion: 2.1 time: 0.219333 Sep 17 21:11:34.707488 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 386/786] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:34 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1574 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:35.698100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e5bb5410-5431-4cd1-9971-aa70cf03b3b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:35.699589 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e5bb5410-5431-4cd1-9971-aa70cf03b3b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:35.706692 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5bb5410-5431-4cd1-9971-aa70cf03b3b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:35.707558 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5bb5410-5431-4cd1-9971-aa70cf03b3b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:35.708245 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5bb5410-5431-4cd1-9971-aa70cf03b3b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:35.709232 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5bb5410-5431-4cd1-9971-aa70cf03b3b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:35.709933 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5bb5410-5431-4cd1-9971-aa70cf03b3b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:35.710849 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5bb5410-5431-4cd1-9971-aa70cf03b3b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:35.743040 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a191ac5-9692-4e99-a915-61ded08f944e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:35.743665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a191ac5-9692-4e99-a915-61ded08f944e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:35.760699 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a191ac5-9692-4e99-a915-61ded08f944e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:35.764042 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a191ac5-9692-4e99-a915-61ded08f944e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:35.765168 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a191ac5-9692-4e99-a915-61ded08f944e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:35.766124 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a191ac5-9692-4e99-a915-61ded08f944e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:35.766761 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a191ac5-9692-4e99-a915-61ded08f944e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:35.767347 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a191ac5-9692-4e99-a915-61ded08f944e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:35.913918 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e5bb5410-5431-4cd1-9971-aa70cf03b3b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:35.923038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e5bb5410-5431-4cd1-9971-aa70cf03b3b1 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1362 microversion: 2.1 time: 0.229440 Sep 17 21:11:35.939791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 401/787] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:35 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:35.959232 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a191ac5-9692-4e99-a915-61ded08f944e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:35.970657 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a191ac5-9692-4e99-a915-61ded08f944e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1574 microversion: 2.1 time: 0.241414 Sep 17 21:11:35.971240 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 387/788] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:35 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1574 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:36.947456 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-62a009dc-cb8e-44ae-a893-8a978765accc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:36.948288 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-62a009dc-cb8e-44ae-a893-8a978765accc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:36.955277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62a009dc-cb8e-44ae-a893-8a978765accc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:36.955771 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62a009dc-cb8e-44ae-a893-8a978765accc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:36.956209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62a009dc-cb8e-44ae-a893-8a978765accc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:36.957067 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62a009dc-cb8e-44ae-a893-8a978765accc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:36.957508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62a009dc-cb8e-44ae-a893-8a978765accc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:36.958054 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62a009dc-cb8e-44ae-a893-8a978765accc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:36.962314 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:36.996201 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d55eae98-1821-41ce-9575-de2df8543674 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:36.997695 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d55eae98-1821-41ce-9575-de2df8543674 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:37.004894 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d55eae98-1821-41ce-9575-de2df8543674 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:37.005478 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d55eae98-1821-41ce-9575-de2df8543674 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:37.005993 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d55eae98-1821-41ce-9575-de2df8543674 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:37.006775 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d55eae98-1821-41ce-9575-de2df8543674 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:37.007441 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d55eae98-1821-41ce-9575-de2df8543674 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:37.007967 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d55eae98-1821-41ce-9575-de2df8543674 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:37.160007 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-62a009dc-cb8e-44ae-a893-8a978765accc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:37.170371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-62a009dc-cb8e-44ae-a893-8a978765accc tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1548 microversion: 2.1 time: 0.226736 Sep 17 21:11:37.173834 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 402/789] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:36 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:37.179675 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-97b0c310-83e5-4135-b3a7-961f54775eb1 req-90db82b4-fba5-44d6-8536-7756d10d579f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3209ceff-722f-437e-9ece-3f9542c1daa7", "name": "network-vif-plugged", "status": "completed", "tag": "9ec72a7a-4fab-4ddb-9a94-b4581d132104"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:37.190722 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-97b0c310-83e5-4135-b3a7-961f54775eb1 req-90db82b4-fba5-44d6-8536-7756d10d579f service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:37.191452 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-97b0c310-83e5-4135-b3a7-961f54775eb1 req-90db82b4-fba5-44d6-8536-7756d10d579f service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:37.193842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-97b0c310-83e5-4135-b3a7-961f54775eb1 req-90db82b4-fba5-44d6-8536-7756d10d579f service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:37.198424 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d55eae98-1821-41ce-9575-de2df8543674 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:37.207298 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d55eae98-1821-41ce-9575-de2df8543674 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1574 microversion: 2.1 time: 0.215511 Sep 17 21:11:37.208144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 388/790] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:36 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1574 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:37.213701 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-97b0c310-83e5-4135-b3a7-961f54775eb1 req-90db82b4-fba5-44d6-8536-7756d10d579f service nova] Creating event network-vif-plugged:9ec72a7a-4fab-4ddb-9a94-b4581d132104 for instance 3209ceff-722f-437e-9ece-3f9542c1daa7 on hv-cinder-82651 Sep 17 21:11:37.214418 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c65303e1-e8f2-4d7a-9248-d6d173538f3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:37.215178 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c65303e1-e8f2-4d7a-9248-d6d173538f3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:37.222028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c65303e1-e8f2-4d7a-9248-d6d173538f3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:37.222186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-97b0c310-83e5-4135-b3a7-961f54775eb1 req-90db82b4-fba5-44d6-8536-7756d10d579f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047069 Sep 17 21:11:37.222655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c65303e1-e8f2-4d7a-9248-d6d173538f3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:37.222773 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 403/791] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:37.223183 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c65303e1-e8f2-4d7a-9248-d6d173538f3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:37.223960 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c65303e1-e8f2-4d7a-9248-d6d173538f3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:37.224624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c65303e1-e8f2-4d7a-9248-d6d173538f3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:37.225177 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c65303e1-e8f2-4d7a-9248-d6d173538f3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:37.326531 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c65303e1-e8f2-4d7a-9248-d6d173538f3b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116959 Sep 17 21:11:37.327213 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 389/792] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 17 21:11:37 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:38.238655 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0be7bd77-319d-4ef5-b410-ab0ca6ddfdb5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:38.239343 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0be7bd77-319d-4ef5-b410-ab0ca6ddfdb5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:38.246391 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0be7bd77-319d-4ef5-b410-ab0ca6ddfdb5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:38.246879 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0be7bd77-319d-4ef5-b410-ab0ca6ddfdb5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:38.247308 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0be7bd77-319d-4ef5-b410-ab0ca6ddfdb5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:38.248014 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0be7bd77-319d-4ef5-b410-ab0ca6ddfdb5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:38.248451 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0be7bd77-319d-4ef5-b410-ab0ca6ddfdb5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:38.249096 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0be7bd77-319d-4ef5-b410-ab0ca6ddfdb5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:38.278229 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ba6c049e-fae0-4815-8bd7-d0000ec2f007 req-06c95779-473e-459f-bdef-829a7ac74a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2de9d30-c24d-41d2-bbdf-79429561d8d6", "tag": "8bdcaef8-e19b-4b96-847b-f6bbb29f455b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:38.287565 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ba6c049e-fae0-4815-8bd7-d0000ec2f007 req-06c95779-473e-459f-bdef-829a7ac74a6a service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:38.288556 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ba6c049e-fae0-4815-8bd7-d0000ec2f007 req-06c95779-473e-459f-bdef-829a7ac74a6a service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:38.289268 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ba6c049e-fae0-4815-8bd7-d0000ec2f007 req-06c95779-473e-459f-bdef-829a7ac74a6a service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:38.300439 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ba6c049e-fae0-4815-8bd7-d0000ec2f007 req-06c95779-473e-459f-bdef-829a7ac74a6a service nova] Creating event network-changed:8bdcaef8-e19b-4b96-847b-f6bbb29f455b for instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 on hv-cinder-82651 Sep 17 21:11:38.305974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ba6c049e-fae0-4815-8bd7-d0000ec2f007 req-06c95779-473e-459f-bdef-829a7ac74a6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031864 Sep 17 21:11:38.306569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 390/793] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:11:38.394869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0be7bd77-319d-4ef5-b410-ab0ca6ddfdb5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:38.402857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0be7bd77-319d-4ef5-b410-ab0ca6ddfdb5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1574 microversion: 2.1 time: 0.168972 Sep 17 21:11:38.403431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 404/794] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:38 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:39.427144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d3e6442-1346-49fe-9c37-7f6da1fefdaa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:39.427916 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d3e6442-1346-49fe-9c37-7f6da1fefdaa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:39.434922 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d3e6442-1346-49fe-9c37-7f6da1fefdaa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:39.435445 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d3e6442-1346-49fe-9c37-7f6da1fefdaa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:39.435911 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d3e6442-1346-49fe-9c37-7f6da1fefdaa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:39.436511 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d3e6442-1346-49fe-9c37-7f6da1fefdaa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:39.437000 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d3e6442-1346-49fe-9c37-7f6da1fefdaa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:39.437474 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d3e6442-1346-49fe-9c37-7f6da1fefdaa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:39.577980 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d3e6442-1346-49fe-9c37-7f6da1fefdaa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:39.585986 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d3e6442-1346-49fe-9c37-7f6da1fefdaa tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1561 microversion: 2.1 time: 0.163435 Sep 17 21:11:39.586776 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 391/795] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:39 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:46.343695 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dc00e908-7b28-47fd-b2b1-6db8e9525f55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:46.344245 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dc00e908-7b28-47fd-b2b1-6db8e9525f55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:46.347032 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:46.353077 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc00e908-7b28-47fd-b2b1-6db8e9525f55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:46.353561 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc00e908-7b28-47fd-b2b1-6db8e9525f55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:46.353998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc00e908-7b28-47fd-b2b1-6db8e9525f55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:46.354700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc00e908-7b28-47fd-b2b1-6db8e9525f55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:46.355151 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc00e908-7b28-47fd-b2b1-6db8e9525f55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:46.355578 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc00e908-7b28-47fd-b2b1-6db8e9525f55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:46.379865 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dc00e908-7b28-47fd-b2b1-6db8e9525f55 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/ips" status: 200 len: 149 microversion: 2.1 time: 0.040118 Sep 17 21:11:46.380437 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 405/796] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 17 21:11:46 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:47.713907 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5081c2a2-8fde-40a2-9be8-eab163bd2d5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "206e1f55-d4e0-45ec-9544-c2e39a53a439"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:47.716188 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5081c2a2-8fde-40a2-9be8-eab163bd2d5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:47.722891 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5081c2a2-8fde-40a2-9be8-eab163bd2d5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:47.723366 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5081c2a2-8fde-40a2-9be8-eab163bd2d5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:47.723794 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5081c2a2-8fde-40a2-9be8-eab163bd2d5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:47.724470 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5081c2a2-8fde-40a2-9be8-eab163bd2d5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:47.724945 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5081c2a2-8fde-40a2-9be8-eab163bd2d5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:47.725364 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5081c2a2-8fde-40a2-9be8-eab163bd2d5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:47.953719 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:47.964260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5081c2a2-8fde-40a2-9be8-eab163bd2d5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254674 Sep 17 21:11:47.964894 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 392/797] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:11:47 2022] POST /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:57.621307 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eef8be77-467f-45f8-9e69-289d608f7f58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "206e1f55-d4e0-45ec-9544-c2e39a53a439"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:57.623652 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eef8be77-467f-45f8-9e69-289d608f7f58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:57.626535 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:57.627183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=16 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:57.633906 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eef8be77-467f-45f8-9e69-289d608f7f58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:57.634395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eef8be77-467f-45f8-9e69-289d608f7f58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:57.634830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eef8be77-467f-45f8-9e69-289d608f7f58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:57.635524 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eef8be77-467f-45f8-9e69-289d608f7f58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:57.635981 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eef8be77-467f-45f8-9e69-289d608f7f58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:57.636404 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eef8be77-467f-45f8-9e69-289d608f7f58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:57.713497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-eef8be77-467f-45f8-9e69-289d608f7f58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Invalid volume: volume 206e1f55-d4e0-45ec-9544-c2e39a53a439 is already attached to instances: 26f1be29-b81c-4f72-99e3-979c1aab0af2 Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eef8be77-467f-45f8-9e69-289d608f7f58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-volume_attachments HTTP/1.1 Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 74 Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:11:57.715219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:11:57.716860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:11:57.716860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:11:57.716860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:11:57.716860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:11:57.716860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:11:57.716860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:11:57.716860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:11:57.716860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:11:57.716860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:11:57.716860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Sep 17 21:11:57.716860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {"volumeAttachment": {"volumeId": "206e1f55-d4e0-45ec-9544-c2e39a53a439"}} Sep 17 21:11:57.716860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Invalid volume: volume 206e1f55-d4e0-45ec-9544-c2e39a53a439 is already attached to instances: 26f1be29-b81c-4f72-99e3-979c1aab0af2 Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'server_id': '26f1be29-b81c-4f72-99e3-979c1aab0af2', 'body': {'volumeAttachment': {'volumeId': '206e1f55-d4e0-45ec-9544-c2e39a53a439'}}} Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 206e1f55-d4e0-45ec-9544-c2e39a53a439 is already attached to instances: 26f1be29-b81c-4f72-99e3-979c1aab0af2 Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:11:57.717887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 206e1f55-d4e0-45ec-9544-c2e39a53a439 is already attached to instances: 26f1be29-b81c-4f72-99e3-979c1aab0af2 Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:57.719360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:57.721286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:57.721286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:57.721286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:57.721286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 206e1f55-d4e0-45ec-9544-c2e39a53a439 is already attached to instances: 26f1be29-b81c-4f72-99e3-979c1aab0af2 Sep 17 21:11:57.721286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:11:57.721286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eef8be77-467f-45f8-9e69-289d608f7f58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 400 to user: Invalid volume: volume 206e1f55-d4e0-45ec-9544-c2e39a53a439 is already attached to instances: 26f1be29-b81c-4f72-99e3-979c1aab0af2 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:57.721286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eef8be77-467f-45f8-9e69-289d608f7f58 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100729 Sep 17 21:11:57.721286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 406/798] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:11:57 2022] POST /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:11:57.779947 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:57.784970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b074f65c-7da6-4759-af82-ac45a38eee95 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:57.785550 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b074f65c-7da6-4759-af82-ac45a38eee95 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:57.794213 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b074f65c-7da6-4759-af82-ac45a38eee95 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:57.794703 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b074f65c-7da6-4759-af82-ac45a38eee95 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:57.795136 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b074f65c-7da6-4759-af82-ac45a38eee95 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:57.795832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b074f65c-7da6-4759-af82-ac45a38eee95 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:57.796289 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b074f65c-7da6-4759-af82-ac45a38eee95 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:57.796736 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b074f65c-7da6-4759-af82-ac45a38eee95 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:57.877294 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-b074f65c-7da6-4759-af82-ac45a38eee95 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lazy-loading 'services' on Instance uuid 26f1be29-b81c-4f72-99e3-979c1aab0af2 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:11:57.946921 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b074f65c-7da6-4759-af82-ac45a38eee95 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-volume_attachments/206e1f55-d4e0-45ec-9544-c2e39a53a439" status: 202 len: 0 microversion: 2.1 time: 0.168195 Sep 17 21:11:57.947481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 393/799] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 17 21:11:57 2022] DELETE /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-volume_attachments/206e1f55-d4e0-45ec-9544-c2e39a53a439 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:11:57.957761 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a7e0140-e119-44d1-808c-eb1d77d6e339 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:57.960198 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a7e0140-e119-44d1-808c-eb1d77d6e339 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:57.970007 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a7e0140-e119-44d1-808c-eb1d77d6e339 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:57.970538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a7e0140-e119-44d1-808c-eb1d77d6e339 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:57.970976 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a7e0140-e119-44d1-808c-eb1d77d6e339 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:57.971692 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a7e0140-e119-44d1-808c-eb1d77d6e339 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:57.972228 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a7e0140-e119-44d1-808c-eb1d77d6e339 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:57.972663 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a7e0140-e119-44d1-808c-eb1d77d6e339 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:58.003356 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a7e0140-e119-44d1-808c-eb1d77d6e339 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051446 Sep 17 21:11:58.003906 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 407/800] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:11:57 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:59.017442 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77fc3a53-ad8a-4ecb-a9d0-bbf6f9cfc856 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:59.019736 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77fc3a53-ad8a-4ecb-a9d0-bbf6f9cfc856 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:59.026467 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77fc3a53-ad8a-4ecb-a9d0-bbf6f9cfc856 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:59.026942 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77fc3a53-ad8a-4ecb-a9d0-bbf6f9cfc856 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:59.027368 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77fc3a53-ad8a-4ecb-a9d0-bbf6f9cfc856 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:59.028047 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77fc3a53-ad8a-4ecb-a9d0-bbf6f9cfc856 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:59.028492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77fc3a53-ad8a-4ecb-a9d0-bbf6f9cfc856 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:59.028958 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77fc3a53-ad8a-4ecb-a9d0-bbf6f9cfc856 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:59.057305 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77fc3a53-ad8a-4ecb-a9d0-bbf6f9cfc856 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044673 Sep 17 21:11:59.057855 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 394/801] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:11:59 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:11:59.119614 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85f27fae-5e9d-48d4-80b8-35b47728932c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:59.120109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85f27fae-5e9d-48d4-80b8-35b47728932c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:59.126438 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85f27fae-5e9d-48d4-80b8-35b47728932c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:59.126922 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85f27fae-5e9d-48d4-80b8-35b47728932c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:59.127363 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85f27fae-5e9d-48d4-80b8-35b47728932c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:59.128055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85f27fae-5e9d-48d4-80b8-35b47728932c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:59.128510 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85f27fae-5e9d-48d4-80b8-35b47728932c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:59.128967 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85f27fae-5e9d-48d4-80b8-35b47728932c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:59.154538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85f27fae-5e9d-48d4-80b8-35b47728932c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:11:59.229379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85f27fae-5e9d-48d4-80b8-35b47728932c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 204 len: 0 microversion: 2.1 time: 0.113123 Sep 17 21:11:59.233635 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 408/802] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:59 2022] DELETE /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:11:59.238914 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd252447-84c5-4a62-81b4-21aa43466e52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:59.239645 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd252447-84c5-4a62-81b4-21aa43466e52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:59.246550 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd252447-84c5-4a62-81b4-21aa43466e52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:59.247038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd252447-84c5-4a62-81b4-21aa43466e52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:59.247479 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd252447-84c5-4a62-81b4-21aa43466e52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:59.248170 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd252447-84c5-4a62-81b4-21aa43466e52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:59.248625 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd252447-84c5-4a62-81b4-21aa43466e52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:59.249082 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd252447-84c5-4a62-81b4-21aa43466e52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:59.393973 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dd252447-84c5-4a62-81b4-21aa43466e52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:59.401964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd252447-84c5-4a62-81b4-21aa43466e52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1681 microversion: 2.1 time: 0.167062 Sep 17 21:11:59.402522 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 395/803] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:59 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:00.426513 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8a6246bd-fa4a-416e-bdd3-344cb1dcfb38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:00.427317 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8a6246bd-fa4a-416e-bdd3-344cb1dcfb38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:00.434134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a6246bd-fa4a-416e-bdd3-344cb1dcfb38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:00.434619 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a6246bd-fa4a-416e-bdd3-344cb1dcfb38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:00.435051 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a6246bd-fa4a-416e-bdd3-344cb1dcfb38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:00.435746 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a6246bd-fa4a-416e-bdd3-344cb1dcfb38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:00.436201 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a6246bd-fa4a-416e-bdd3-344cb1dcfb38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:00.436623 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a6246bd-fa4a-416e-bdd3-344cb1dcfb38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:00.568038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8a6246bd-fa4a-416e-bdd3-344cb1dcfb38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:00.576701 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8a6246bd-fa4a-416e-bdd3-344cb1dcfb38 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1681 microversion: 2.1 time: 0.154494 Sep 17 21:12:00.577272 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 409/804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:00 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:01.599495 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1819a932-8b76-4026-b9be-7ecb8b22412f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:01.600343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1819a932-8b76-4026-b9be-7ecb8b22412f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:01.608371 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1819a932-8b76-4026-b9be-7ecb8b22412f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:01.609052 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1819a932-8b76-4026-b9be-7ecb8b22412f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:01.609527 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1819a932-8b76-4026-b9be-7ecb8b22412f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:01.610242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1819a932-8b76-4026-b9be-7ecb8b22412f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:01.618452 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1819a932-8b76-4026-b9be-7ecb8b22412f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:01.619309 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1819a932-8b76-4026-b9be-7ecb8b22412f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:01.826773 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1819a932-8b76-4026-b9be-7ecb8b22412f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:01.836394 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1819a932-8b76-4026-b9be-7ecb8b22412f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 200 len: 1681 microversion: 2.1 time: 0.240762 Sep 17 21:12:01.848947 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 396/805] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:01 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:02.192047 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9432ae15-1486-4164-8cd7-1d539a4ed49a req-47a0c8ff-84f2-4a4c-a9d1-4674672791de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f1be29-b81c-4f72-99e3-979c1aab0af2", "name": "network-vif-deleted", "tag": "0d83c88e-4130-4aea-9402-15f46ff88289"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:02.203858 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9432ae15-1486-4164-8cd7-1d539a4ed49a req-47a0c8ff-84f2-4a4c-a9d1-4674672791de service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:02.204331 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9432ae15-1486-4164-8cd7-1d539a4ed49a req-47a0c8ff-84f2-4a4c-a9d1-4674672791de service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:02.204809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9432ae15-1486-4164-8cd7-1d539a4ed49a req-47a0c8ff-84f2-4a4c-a9d1-4674672791de service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:02.217511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9432ae15-1486-4164-8cd7-1d539a4ed49a req-47a0c8ff-84f2-4a4c-a9d1-4674672791de service nova] Creating event network-vif-deleted:0d83c88e-4130-4aea-9402-15f46ff88289 for instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 on hv-cinder-82651 Sep 17 21:12:02.222197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9432ae15-1486-4164-8cd7-1d539a4ed49a req-47a0c8ff-84f2-4a4c-a9d1-4674672791de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034158 Sep 17 21:12:02.222786 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 410/806] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:02.860345 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1889b2a2-4126-4faa-aecf-83a4af039cb9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:02.861221 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1889b2a2-4126-4faa-aecf-83a4af039cb9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:02.868312 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1889b2a2-4126-4faa-aecf-83a4af039cb9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:02.869029 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1889b2a2-4126-4faa-aecf-83a4af039cb9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:02.869537 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1889b2a2-4126-4faa-aecf-83a4af039cb9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:02.870235 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1889b2a2-4126-4faa-aecf-83a4af039cb9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:02.870691 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1889b2a2-4126-4faa-aecf-83a4af039cb9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:02.871111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1889b2a2-4126-4faa-aecf-83a4af039cb9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:02.884851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-1889b2a2-4126-4faa-aecf-83a4af039cb9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1889b2a2-4126-4faa-aecf-83a4af039cb9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 HTTP/1.1 Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:12:02.886519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:12:02.887901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:12:02.887901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:12:02.887901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:12:02.887901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:12:02.887901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:12:02.887901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:12:02.887901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:12:02.887901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:12:02.887901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:12:02.887901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:12:02.887901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:12:02.887901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '26f1be29-b81c-4f72-99e3-979c1aab0af2'} Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:12:02.888818 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:12:02.890924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:12:02.893120 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1889b2a2-4126-4faa-aecf-83a4af039cb9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 404 to user: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:12:02.896358 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1889b2a2-4126-4faa-aecf-83a4af039cb9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 404 len: 111 microversion: 2.1 time: 0.039812 Sep 17 21:12:02.897448 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 397/807] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:02 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:12:02.915695 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b95e21d9-b438-41ee-91e0-f5882f29e1d6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '.version_select at 0x7f9ba73599d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:02.944318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b95e21d9-b438-41ee-91e0-f5882f29e1d6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013666660" status: 202 len: 0 microversion: 2.1 time: 0.035202 Sep 17 21:12:02.944318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 411/808] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 17 21:12:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013666660 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:12:03.573443 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2929248e-3ffc-4f74-8535-cdd57e4141af tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: .version_select at 0x7f9ba7581430>, body: {"keypair": {"name": "tempest-keypair-1857807033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcfXyZTh6D3ceCV+fDiquUQiuscAowa1YYa4WhPQQMguH/HYdWSUMAUY+C3xrxMIJ5z5VeQJDg0Am4NxPSjcDUQKAwZWk44vh+1Jq+JsiIw/0R0jgEu8sqnZd8osL5EWg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:03.588748 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-2929248e-3ffc-4f74-8535-cdd57e4141af tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for project d9689fd1a04647cf91a73680e4b677d1. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:12:03.592419 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-2929248e-3ffc-4f74-8535-cdd57e4141af tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for user 1e3b1e0f4888400b89c47b3e44443228 and project d9689fd1a04647cf91a73680e4b677d1. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:12:03.614203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2929248e-3ffc-4f74-8535-cdd57e4141af tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045565 Sep 17 21:12:03.614791 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 398/809] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 17 21:12:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:04.896863 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-741003103", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2c320a7-411d-4280-a740-e3d2f3da6961"}], "security_groups": [{"name": "tempest-securitygroup--742961491"}], "key_name": "tempest-keypair-1857807033", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:04.998534 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] validate_networks() for [('b2c320a7-411d-4280-a740-e3d2f3da6961', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:12:05.621468 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:12:05.621888 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:12:05.622359 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:12:05.622767 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:12:05.623176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:12:05.631914 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:05.632391 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:05.632873 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:05.633819 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:05.634279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:05.634700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:05.652689 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for project d9689fd1a04647cf91a73680e4b677d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:12:05.656824 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Getting quotas for user 1e3b1e0f4888400b89c47b3e44443228 and project d9689fd1a04647cf91a73680e4b677d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:12:05.668567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:12:05.670983 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:12:05.717772 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a109c50-2188-4a15-b09b-26344e4406d4 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.825164 Sep 17 21:12:05.718405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 412/810] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:12:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:12:05.732428 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdbf42c3-a2f6-4c12-9e92-0854e9e88a5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:05.733066 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cdbf42c3-a2f6-4c12-9e92-0854e9e88a5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:05.787745 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cdbf42c3-a2f6-4c12-9e92-0854e9e88a5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:05.795288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cdbf42c3-a2f6-4c12-9e92-0854e9e88a5f tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1241 microversion: 2.1 time: 0.068073 Sep 17 21:12:05.795856 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 399/811] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:05 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:06.819393 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3d47f7a-3f02-471a-8f00-94e2217ef7c0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:06.820043 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d3d47f7a-3f02-471a-8f00-94e2217ef7c0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:06.827334 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3d47f7a-3f02-471a-8f00-94e2217ef7c0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:06.827830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3d47f7a-3f02-471a-8f00-94e2217ef7c0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:06.828497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3d47f7a-3f02-471a-8f00-94e2217ef7c0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:06.829420 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3d47f7a-3f02-471a-8f00-94e2217ef7c0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:06.830046 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3d47f7a-3f02-471a-8f00-94e2217ef7c0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:06.830613 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3d47f7a-3f02-471a-8f00-94e2217ef7c0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:06.920081 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d3d47f7a-3f02-471a-8f00-94e2217ef7c0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:06.931042 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3d47f7a-3f02-471a-8f00-94e2217ef7c0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1301 microversion: 2.1 time: 0.115496 Sep 17 21:12:06.931942 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 413/812] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:06 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1301 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:07.956303 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bfc60b28-7fd2-45a8-ace0-9226de741371 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:07.957627 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bfc60b28-7fd2-45a8-ace0-9226de741371 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:07.965723 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfc60b28-7fd2-45a8-ace0-9226de741371 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:07.966142 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfc60b28-7fd2-45a8-ace0-9226de741371 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:07.966577 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfc60b28-7fd2-45a8-ace0-9226de741371 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:07.967276 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfc60b28-7fd2-45a8-ace0-9226de741371 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:07.967725 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfc60b28-7fd2-45a8-ace0-9226de741371 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:07.968142 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfc60b28-7fd2-45a8-ace0-9226de741371 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:08.238031 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bfc60b28-7fd2-45a8-ace0-9226de741371 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:08.247429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bfc60b28-7fd2-45a8-ace0-9226de741371 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1366 microversion: 2.1 time: 0.296375 Sep 17 21:12:08.248008 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 400/813] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:07 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:12:08.416241 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-407df40d-8c20-407e-9a99-796eee596eb5 req-6cb25be7-0127-4323-a578-a805dd25ab3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7665dbfa-de1c-496f-88cf-c31beb10b5c8", "tag": "d054d99f-b752-4115-b6d8-e10e63d40716"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:08.428270 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-407df40d-8c20-407e-9a99-796eee596eb5 req-6cb25be7-0127-4323-a578-a805dd25ab3d service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:08.428694 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-407df40d-8c20-407e-9a99-796eee596eb5 req-6cb25be7-0127-4323-a578-a805dd25ab3d service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:08.429629 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-407df40d-8c20-407e-9a99-796eee596eb5 req-6cb25be7-0127-4323-a578-a805dd25ab3d service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:08.445026 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-407df40d-8c20-407e-9a99-796eee596eb5 req-6cb25be7-0127-4323-a578-a805dd25ab3d service nova] Creating event network-changed:d054d99f-b752-4115-b6d8-e10e63d40716 for instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 on hv-cinder-82651 Sep 17 21:12:08.450364 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-407df40d-8c20-407e-9a99-796eee596eb5 req-6cb25be7-0127-4323-a578-a805dd25ab3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038484 Sep 17 21:12:08.451366 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 414/814] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:09.272337 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61c2f1fe-ddf5-499b-9e58-f2482a233ee7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:09.272985 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61c2f1fe-ddf5-499b-9e58-f2482a233ee7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:09.279581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c2f1fe-ddf5-499b-9e58-f2482a233ee7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:09.280072 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c2f1fe-ddf5-499b-9e58-f2482a233ee7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:09.280538 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c2f1fe-ddf5-499b-9e58-f2482a233ee7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:09.281286 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c2f1fe-ddf5-499b-9e58-f2482a233ee7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:09.281863 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c2f1fe-ddf5-499b-9e58-f2482a233ee7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:09.282298 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c2f1fe-ddf5-499b-9e58-f2482a233ee7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:09.421454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-61c2f1fe-ddf5-499b-9e58-f2482a233ee7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:09.429053 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61c2f1fe-ddf5-499b-9e58-f2482a233ee7 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1366 microversion: 2.1 time: 0.160474 Sep 17 21:12:09.429604 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 401/815] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:09 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:10.451975 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b4deb5af-04c8-4c92-9663-d90dde730a84 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:10.452667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b4deb5af-04c8-4c92-9663-d90dde730a84 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:10.459522 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4deb5af-04c8-4c92-9663-d90dde730a84 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:10.459998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4deb5af-04c8-4c92-9663-d90dde730a84 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:10.460424 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4deb5af-04c8-4c92-9663-d90dde730a84 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:10.461214 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4deb5af-04c8-4c92-9663-d90dde730a84 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:10.461755 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4deb5af-04c8-4c92-9663-d90dde730a84 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:10.462175 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4deb5af-04c8-4c92-9663-d90dde730a84 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:10.589278 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b4deb5af-04c8-4c92-9663-d90dde730a84 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:10.596981 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b4deb5af-04c8-4c92-9663-d90dde730a84 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1366 microversion: 2.1 time: 0.149091 Sep 17 21:12:10.597635 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 415/816] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:10 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:11.620930 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cb1956d4-fd2b-44e0-94dd-2d1eb1f8f9a9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:11.621648 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cb1956d4-fd2b-44e0-94dd-2d1eb1f8f9a9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:11.627944 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb1956d4-fd2b-44e0-94dd-2d1eb1f8f9a9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:11.628422 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb1956d4-fd2b-44e0-94dd-2d1eb1f8f9a9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:11.628889 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb1956d4-fd2b-44e0-94dd-2d1eb1f8f9a9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:11.629572 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb1956d4-fd2b-44e0-94dd-2d1eb1f8f9a9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:11.630024 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb1956d4-fd2b-44e0-94dd-2d1eb1f8f9a9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:11.630443 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb1956d4-fd2b-44e0-94dd-2d1eb1f8f9a9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:11.766652 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cb1956d4-fd2b-44e0-94dd-2d1eb1f8f9a9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:11.774657 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cb1956d4-fd2b-44e0-94dd-2d1eb1f8f9a9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1366 microversion: 2.1 time: 0.158443 Sep 17 21:12:11.775222 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 402/817] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:11 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:12.797606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d895211-ba4f-4f04-a510-e1c15d3abfde tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:12.798246 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2d895211-ba4f-4f04-a510-e1c15d3abfde tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:12.804627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d895211-ba4f-4f04-a510-e1c15d3abfde tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:12.805983 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d895211-ba4f-4f04-a510-e1c15d3abfde tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:12.806433 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d895211-ba4f-4f04-a510-e1c15d3abfde tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:12.807132 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d895211-ba4f-4f04-a510-e1c15d3abfde tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:12.807595 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d895211-ba4f-4f04-a510-e1c15d3abfde tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:12.808020 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d895211-ba4f-4f04-a510-e1c15d3abfde tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:12.937861 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2d895211-ba4f-4f04-a510-e1c15d3abfde tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:12.945922 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2d895211-ba4f-4f04-a510-e1c15d3abfde tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1366 microversion: 2.1 time: 0.152091 Sep 17 21:12:12.946479 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 416/818] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:12 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:13.967929 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c212a6e7-0f01-4b7b-a99e-f243cc042c10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:13.968541 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c212a6e7-0f01-4b7b-a99e-f243cc042c10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:13.974933 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c212a6e7-0f01-4b7b-a99e-f243cc042c10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:13.975414 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c212a6e7-0f01-4b7b-a99e-f243cc042c10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:13.975844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c212a6e7-0f01-4b7b-a99e-f243cc042c10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:13.976663 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c212a6e7-0f01-4b7b-a99e-f243cc042c10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:13.977097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c212a6e7-0f01-4b7b-a99e-f243cc042c10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:13.977548 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c212a6e7-0f01-4b7b-a99e-f243cc042c10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:14.107415 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c212a6e7-0f01-4b7b-a99e-f243cc042c10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:14.115115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c212a6e7-0f01-4b7b-a99e-f243cc042c10 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1366 microversion: 2.1 time: 0.151125 Sep 17 21:12:14.115678 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 403/819] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:13 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:15.140443 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b532f002-c3ab-4b84-8c1e-291602ff6dcd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:15.141118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b532f002-c3ab-4b84-8c1e-291602ff6dcd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:15.147412 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b532f002-c3ab-4b84-8c1e-291602ff6dcd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:15.147887 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b532f002-c3ab-4b84-8c1e-291602ff6dcd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:15.148931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b532f002-c3ab-4b84-8c1e-291602ff6dcd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:15.149758 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b532f002-c3ab-4b84-8c1e-291602ff6dcd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:15.150212 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b532f002-c3ab-4b84-8c1e-291602ff6dcd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:15.150634 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b532f002-c3ab-4b84-8c1e-291602ff6dcd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:15.282703 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b532f002-c3ab-4b84-8c1e-291602ff6dcd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:15.290742 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b532f002-c3ab-4b84-8c1e-291602ff6dcd tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1366 microversion: 2.1 time: 0.154450 Sep 17 21:12:15.291311 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 417/820] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:15 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:15.341200 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a8c0d9bd-e7be-4ebc-b51b-32e426225d1f req-8abb37d8-ce9d-46ff-9192-50baa5d99458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7665dbfa-de1c-496f-88cf-c31beb10b5c8", "name": "network-vif-plugged", "status": "completed", "tag": "d054d99f-b752-4115-b6d8-e10e63d40716"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:15.351312 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a8c0d9bd-e7be-4ebc-b51b-32e426225d1f req-8abb37d8-ce9d-46ff-9192-50baa5d99458 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:15.351996 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a8c0d9bd-e7be-4ebc-b51b-32e426225d1f req-8abb37d8-ce9d-46ff-9192-50baa5d99458 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:15.352423 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a8c0d9bd-e7be-4ebc-b51b-32e426225d1f req-8abb37d8-ce9d-46ff-9192-50baa5d99458 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:15.364258 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a8c0d9bd-e7be-4ebc-b51b-32e426225d1f req-8abb37d8-ce9d-46ff-9192-50baa5d99458 service nova] Creating event network-vif-plugged:d054d99f-b752-4115-b6d8-e10e63d40716 for instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 on hv-cinder-82651 Sep 17 21:12:15.370377 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a8c0d9bd-e7be-4ebc-b51b-32e426225d1f req-8abb37d8-ce9d-46ff-9192-50baa5d99458 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032848 Sep 17 21:12:15.371416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 404/821] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:16.313636 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f2c1335-4159-48cc-91f4-b405667781f3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:16.314240 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6f2c1335-4159-48cc-91f4-b405667781f3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:16.316157 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:16.317224 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:16.324590 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f2c1335-4159-48cc-91f4-b405667781f3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:16.325098 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f2c1335-4159-48cc-91f4-b405667781f3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:16.325576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f2c1335-4159-48cc-91f4-b405667781f3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:16.326266 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f2c1335-4159-48cc-91f4-b405667781f3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:16.326720 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f2c1335-4159-48cc-91f4-b405667781f3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:16.327144 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f2c1335-4159-48cc-91f4-b405667781f3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:16.459708 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6f2c1335-4159-48cc-91f4-b405667781f3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:16.467336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6f2c1335-4159-48cc-91f4-b405667781f3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1366 microversion: 2.1 time: 0.157542 Sep 17 21:12:16.467898 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 418/822] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:16 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:17.487333 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:17.492812 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc02cf90-35a7-40ef-91bb-11e6728dc80b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:17.493501 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc02cf90-35a7-40ef-91bb-11e6728dc80b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:17.499921 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc02cf90-35a7-40ef-91bb-11e6728dc80b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:17.500398 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc02cf90-35a7-40ef-91bb-11e6728dc80b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:17.500860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc02cf90-35a7-40ef-91bb-11e6728dc80b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:17.501577 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc02cf90-35a7-40ef-91bb-11e6728dc80b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:17.502023 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc02cf90-35a7-40ef-91bb-11e6728dc80b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:17.502438 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc02cf90-35a7-40ef-91bb-11e6728dc80b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:17.632066 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fc02cf90-35a7-40ef-91bb-11e6728dc80b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:17.640597 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc02cf90-35a7-40ef-91bb-11e6728dc80b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1555 microversion: 2.1 time: 0.154187 Sep 17 21:12:17.641174 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 405/823] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:17 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:17.662382 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2125cfbf-db91-4df3-973f-e3df87c76524 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:17.662885 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2125cfbf-db91-4df3-973f-e3df87c76524 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:17.669301 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2125cfbf-db91-4df3-973f-e3df87c76524 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:17.669782 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2125cfbf-db91-4df3-973f-e3df87c76524 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:17.670217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2125cfbf-db91-4df3-973f-e3df87c76524 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:17.670905 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2125cfbf-db91-4df3-973f-e3df87c76524 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:17.671367 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2125cfbf-db91-4df3-973f-e3df87c76524 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:17.671805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2125cfbf-db91-4df3-973f-e3df87c76524 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:17.749444 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2125cfbf-db91-4df3-973f-e3df87c76524 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090946 Sep 17 21:12:17.750031 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 419/824] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 17 21:12:17 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:18.668065 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2f5e0560-8a05-4290-b9b0-955343fded3c req-cb252309-f863-47e0-a94a-db6602eaee7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7665dbfa-de1c-496f-88cf-c31beb10b5c8", "tag": "d054d99f-b752-4115-b6d8-e10e63d40716"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:18.678182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2f5e0560-8a05-4290-b9b0-955343fded3c req-cb252309-f863-47e0-a94a-db6602eaee7e service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:18.678753 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2f5e0560-8a05-4290-b9b0-955343fded3c req-cb252309-f863-47e0-a94a-db6602eaee7e service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:18.679246 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2f5e0560-8a05-4290-b9b0-955343fded3c req-cb252309-f863-47e0-a94a-db6602eaee7e service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:18.691120 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2f5e0560-8a05-4290-b9b0-955343fded3c req-cb252309-f863-47e0-a94a-db6602eaee7e service nova] Creating event network-changed:d054d99f-b752-4115-b6d8-e10e63d40716 for instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 on hv-cinder-82651 Sep 17 21:12:18.696836 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2f5e0560-8a05-4290-b9b0-955343fded3c req-cb252309-f863-47e0-a94a-db6602eaee7e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032164 Sep 17 21:12:18.697757 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 406/825] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:53.412369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:53.413157 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:53.635130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b10d71dc-71ac-45cb-9cbf-2dd1d6f698eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:53.635624 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b10d71dc-71ac-45cb-9cbf-2dd1d6f698eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:53.641617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b10d71dc-71ac-45cb-9cbf-2dd1d6f698eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:53.642259 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b10d71dc-71ac-45cb-9cbf-2dd1d6f698eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:53.642699 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b10d71dc-71ac-45cb-9cbf-2dd1d6f698eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:53.643449 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b10d71dc-71ac-45cb-9cbf-2dd1d6f698eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:53.644157 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b10d71dc-71ac-45cb-9cbf-2dd1d6f698eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:53.644781 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b10d71dc-71ac-45cb-9cbf-2dd1d6f698eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:53.670126 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b10d71dc-71ac-45cb-9cbf-2dd1d6f698eb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/ips" status: 200 len: 151 microversion: 2.20 time: 0.259149 Sep 17 21:12:53.670683 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 420/826] 10.222.0.16 () {60 vars in 1289 bytes} [Sat Sep 17 21:12:53 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/ips => generated 151 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:12:55.889088 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:55.890270 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:55.896525 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b6dcf2a9-7893-4403-94d6-ffbe5f37a622 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:55.898023 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b6dcf2a9-7893-4403-94d6-ffbe5f37a622 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:55.906598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6dcf2a9-7893-4403-94d6-ffbe5f37a622 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:55.907706 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6dcf2a9-7893-4403-94d6-ffbe5f37a622 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:55.908388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6dcf2a9-7893-4403-94d6-ffbe5f37a622 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:55.909552 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6dcf2a9-7893-4403-94d6-ffbe5f37a622 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:55.910369 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6dcf2a9-7893-4403-94d6-ffbe5f37a622 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:55.911039 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6dcf2a9-7893-4403-94d6-ffbe5f37a622 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:55.939646 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-b6dcf2a9-7893-4403-94d6-ffbe5f37a622 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lazy-loading 'flavor' on Instance uuid 60a67b77-200a-44df-918e-757ee2cae914 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:12:56.227674 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b6dcf2a9-7893-4403-94d6-ffbe5f37a622 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "POST /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/action" status: 202 len: 0 microversion: 2.20 time: 0.340218 Sep 17 21:12:56.233565 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 407/827] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 17 21:12:55 2022] POST /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:12:56.248733 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b11d5acf-1113-4af2-a0df-4ac1ebc27536 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:56.248733 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b11d5acf-1113-4af2-a0df-4ac1ebc27536 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:56.259427 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11d5acf-1113-4af2-a0df-4ac1ebc27536 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:56.263044 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11d5acf-1113-4af2-a0df-4ac1ebc27536 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:56.263852 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11d5acf-1113-4af2-a0df-4ac1ebc27536 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:56.264877 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11d5acf-1113-4af2-a0df-4ac1ebc27536 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:56.265585 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11d5acf-1113-4af2-a0df-4ac1ebc27536 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:56.266225 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11d5acf-1113-4af2-a0df-4ac1ebc27536 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:56.442606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b11d5acf-1113-4af2-a0df-4ac1ebc27536 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:56.453490 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b11d5acf-1113-4af2-a0df-4ac1ebc27536 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:56.454958 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b11d5acf-1113-4af2-a0df-4ac1ebc27536 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:56.456134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b11d5acf-1113-4af2-a0df-4ac1ebc27536 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.222219 Sep 17 21:12:56.456892 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 421/828] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:12:56 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:12:57.483048 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-39c18cd1-8581-4e4c-ad60-cd2166410f05 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:57.484761 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-39c18cd1-8581-4e4c-ad60-cd2166410f05 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:57.493958 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39c18cd1-8581-4e4c-ad60-cd2166410f05 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:57.494571 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39c18cd1-8581-4e4c-ad60-cd2166410f05 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:57.495105 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39c18cd1-8581-4e4c-ad60-cd2166410f05 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:57.495915 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39c18cd1-8581-4e4c-ad60-cd2166410f05 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:57.496497 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39c18cd1-8581-4e4c-ad60-cd2166410f05 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:57.497050 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39c18cd1-8581-4e4c-ad60-cd2166410f05 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:57.641097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-39c18cd1-8581-4e4c-ad60-cd2166410f05 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:57.649889 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-39c18cd1-8581-4e4c-ad60-cd2166410f05 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:57.651356 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-39c18cd1-8581-4e4c-ad60-cd2166410f05 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:57.652538 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-39c18cd1-8581-4e4c-ad60-cd2166410f05 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.173883 Sep 17 21:12:57.653126 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 408/829] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:12:57 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:12:58.680330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f8f9bc6d-29eb-4b84-967c-420fc0dd30f0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:58.681166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f8f9bc6d-29eb-4b84-967c-420fc0dd30f0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:58.687723 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8f9bc6d-29eb-4b84-967c-420fc0dd30f0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:58.688552 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8f9bc6d-29eb-4b84-967c-420fc0dd30f0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:58.689273 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8f9bc6d-29eb-4b84-967c-420fc0dd30f0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:58.690307 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8f9bc6d-29eb-4b84-967c-420fc0dd30f0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:58.690841 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8f9bc6d-29eb-4b84-967c-420fc0dd30f0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:58.691600 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8f9bc6d-29eb-4b84-967c-420fc0dd30f0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:58.871009 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f8f9bc6d-29eb-4b84-967c-420fc0dd30f0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:58.881435 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f8f9bc6d-29eb-4b84-967c-420fc0dd30f0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:58.883943 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f8f9bc6d-29eb-4b84-967c-420fc0dd30f0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:58.885354 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f8f9bc6d-29eb-4b84-967c-420fc0dd30f0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.210049 Sep 17 21:12:58.886482 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 422/830] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:12:58 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:12:59.921023 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b03e3d81-84d9-42a3-8f27-73c08e7f9aa0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:59.921575 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b03e3d81-84d9-42a3-8f27-73c08e7f9aa0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:59.929107 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b03e3d81-84d9-42a3-8f27-73c08e7f9aa0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:59.930136 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b03e3d81-84d9-42a3-8f27-73c08e7f9aa0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:59.930786 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b03e3d81-84d9-42a3-8f27-73c08e7f9aa0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:59.931943 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b03e3d81-84d9-42a3-8f27-73c08e7f9aa0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:59.932612 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b03e3d81-84d9-42a3-8f27-73c08e7f9aa0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:59.933347 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b03e3d81-84d9-42a3-8f27-73c08e7f9aa0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:00.077942 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b03e3d81-84d9-42a3-8f27-73c08e7f9aa0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:00.088832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b03e3d81-84d9-42a3-8f27-73c08e7f9aa0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:00.090662 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b03e3d81-84d9-42a3-8f27-73c08e7f9aa0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:00.092168 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b03e3d81-84d9-42a3-8f27-73c08e7f9aa0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.177418 Sep 17 21:13:00.093414 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 409/831] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:12:59 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:01.119969 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7182adba-a9ac-452e-b335-51e3d3b52b10 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:01.121214 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7182adba-a9ac-452e-b335-51e3d3b52b10 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:01.127629 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7182adba-a9ac-452e-b335-51e3d3b52b10 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:01.128428 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7182adba-a9ac-452e-b335-51e3d3b52b10 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:01.129136 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7182adba-a9ac-452e-b335-51e3d3b52b10 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:01.130361 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7182adba-a9ac-452e-b335-51e3d3b52b10 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:01.131024 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7182adba-a9ac-452e-b335-51e3d3b52b10 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:01.131689 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7182adba-a9ac-452e-b335-51e3d3b52b10 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:01.446288 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7182adba-a9ac-452e-b335-51e3d3b52b10 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:01.457871 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7182adba-a9ac-452e-b335-51e3d3b52b10 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:01.461788 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7182adba-a9ac-452e-b335-51e3d3b52b10 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:01.465762 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7182adba-a9ac-452e-b335-51e3d3b52b10 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.350169 Sep 17 21:13:01.466565 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 423/832] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:01 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:02.502085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61b73afa-3e69-4901-aaef-4fe6993ab484 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:02.509633 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-61b73afa-3e69-4901-aaef-4fe6993ab484 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:02.513373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f8d169b7-a1c6-4a47-8f79-e72aeab3d9f9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Action: 'create', calling method: .version_select at 0x7f9baacc3e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-70796160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkMuFMpXPAwY8BPl8PJpQBi8g7y6p1v+AfzoOHOpq/rtxLKXRyqCTQ+7eH69vCfNxJ5ao4dU/t8p1aeDADXKEv1QGQqzYsU6mz+eQfTwnYhF2ALvFIqQZui8aenDo5ZXA=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:02.516181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b73afa-3e69-4901-aaef-4fe6993ab484 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:02.516701 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b73afa-3e69-4901-aaef-4fe6993ab484 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:02.517135 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b73afa-3e69-4901-aaef-4fe6993ab484 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:02.517846 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b73afa-3e69-4901-aaef-4fe6993ab484 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:02.518306 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b73afa-3e69-4901-aaef-4fe6993ab484 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:02.518741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b73afa-3e69-4901-aaef-4fe6993ab484 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:02.531276 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-f8d169b7-a1c6-4a47-8f79-e72aeab3d9f9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Getting quotas for project f58304cb0e1a42ce9bbc5ea8a3e58899. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:13:02.535441 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-f8d169b7-a1c6-4a47-8f79-e72aeab3d9f9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Getting quotas for user 91f2a01f833d4751a6f81d6a8f11b8ed and project f58304cb0e1a42ce9bbc5ea8a3e58899. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:13:02.560049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f8d169b7-a1c6-4a47-8f79-e72aeab3d9f9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.220052 Sep 17 21:13:02.564156 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 410/833] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 17 21:13:02 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:02.670180 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-61b73afa-3e69-4901-aaef-4fe6993ab484 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:02.681254 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-61b73afa-3e69-4901-aaef-4fe6993ab484 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:02.682835 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-61b73afa-3e69-4901-aaef-4fe6993ab484 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:02.684330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-61b73afa-3e69-4901-aaef-4fe6993ab484 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.188749 Sep 17 21:13:02.685451 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 424/834] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:02 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:03.711880 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4b74cfe-57f4-42b0-baea-79c50eb62488 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:03.712486 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e4b74cfe-57f4-42b0-baea-79c50eb62488 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:03.719135 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4b74cfe-57f4-42b0-baea-79c50eb62488 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:03.719620 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4b74cfe-57f4-42b0-baea-79c50eb62488 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:03.720087 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4b74cfe-57f4-42b0-baea-79c50eb62488 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:03.720804 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4b74cfe-57f4-42b0-baea-79c50eb62488 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:03.721259 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4b74cfe-57f4-42b0-baea-79c50eb62488 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:03.721860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4b74cfe-57f4-42b0-baea-79c50eb62488 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:03.860585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4b74cfe-57f4-42b0-baea-79c50eb62488 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:03.869865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4b74cfe-57f4-42b0-baea-79c50eb62488 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:03.871540 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4b74cfe-57f4-42b0-baea-79c50eb62488 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:03.872775 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4b74cfe-57f4-42b0-baea-79c50eb62488 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.165806 Sep 17 21:13:03.873339 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 411/835] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:03 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:04.899801 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a692f62-8cc2-41d1-a19b-8f3d9f925f2f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:04.900408 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a692f62-8cc2-41d1-a19b-8f3d9f925f2f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:04.907055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a692f62-8cc2-41d1-a19b-8f3d9f925f2f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:04.907478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a692f62-8cc2-41d1-a19b-8f3d9f925f2f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:04.907908 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a692f62-8cc2-41d1-a19b-8f3d9f925f2f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:04.908606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a692f62-8cc2-41d1-a19b-8f3d9f925f2f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:04.909082 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a692f62-8cc2-41d1-a19b-8f3d9f925f2f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:04.909503 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a692f62-8cc2-41d1-a19b-8f3d9f925f2f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:05.041994 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9a692f62-8cc2-41d1-a19b-8f3d9f925f2f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:05.052305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9a692f62-8cc2-41d1-a19b-8f3d9f925f2f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:05.054548 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9a692f62-8cc2-41d1-a19b-8f3d9f925f2f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:05.055998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9a692f62-8cc2-41d1-a19b-8f3d9f925f2f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.160820 Sep 17 21:13:05.057148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 425/836] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:04 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:06.083949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2eb091c4-6eee-4076-8fbf-f981ca3455ca tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:06.086018 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2eb091c4-6eee-4076-8fbf-f981ca3455ca tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:06.093067 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2eb091c4-6eee-4076-8fbf-f981ca3455ca tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:06.093774 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2eb091c4-6eee-4076-8fbf-f981ca3455ca tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:06.094177 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2eb091c4-6eee-4076-8fbf-f981ca3455ca tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:06.094897 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2eb091c4-6eee-4076-8fbf-f981ca3455ca tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:06.095359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2eb091c4-6eee-4076-8fbf-f981ca3455ca tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:06.095834 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2eb091c4-6eee-4076-8fbf-f981ca3455ca tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:06.268953 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2eb091c4-6eee-4076-8fbf-f981ca3455ca tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:06.278504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2eb091c4-6eee-4076-8fbf-f981ca3455ca tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:06.280267 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2eb091c4-6eee-4076-8fbf-f981ca3455ca tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:06.282410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2eb091c4-6eee-4076-8fbf-f981ca3455ca tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.202605 Sep 17 21:13:06.296698 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 412/837] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:06 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:07.309980 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8617585c-ee32-4934-94d7-f6c9af5635ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:07.310595 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8617585c-ee32-4934-94d7-f6c9af5635ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:07.317186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8617585c-ee32-4934-94d7-f6c9af5635ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:07.317665 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8617585c-ee32-4934-94d7-f6c9af5635ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:07.318094 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8617585c-ee32-4934-94d7-f6c9af5635ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:07.318778 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8617585c-ee32-4934-94d7-f6c9af5635ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:07.319911 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8617585c-ee32-4934-94d7-f6c9af5635ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:07.320332 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8617585c-ee32-4934-94d7-f6c9af5635ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:07.452321 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8617585c-ee32-4934-94d7-f6c9af5635ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:07.460276 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8617585c-ee32-4934-94d7-f6c9af5635ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:07.461782 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8617585c-ee32-4934-94d7-f6c9af5635ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:07.462883 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8617585c-ee32-4934-94d7-f6c9af5635ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.156902 Sep 17 21:13:07.463446 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 426/838] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:07 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:08.489039 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd2decf3-97c7-4421-b439-36c70bd9cec3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:08.489627 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd2decf3-97c7-4421-b439-36c70bd9cec3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:08.496465 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd2decf3-97c7-4421-b439-36c70bd9cec3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:08.496986 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd2decf3-97c7-4421-b439-36c70bd9cec3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:08.497409 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd2decf3-97c7-4421-b439-36c70bd9cec3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:08.498145 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd2decf3-97c7-4421-b439-36c70bd9cec3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:08.498538 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd2decf3-97c7-4421-b439-36c70bd9cec3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:08.498957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd2decf3-97c7-4421-b439-36c70bd9cec3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:08.629046 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd2decf3-97c7-4421-b439-36c70bd9cec3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:08.638090 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd2decf3-97c7-4421-b439-36c70bd9cec3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:08.639544 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd2decf3-97c7-4421-b439-36c70bd9cec3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:08.640865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd2decf3-97c7-4421-b439-36c70bd9cec3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1742 microversion: 2.20 time: 0.155636 Sep 17 21:13:08.641435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 413/839] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:08 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:09.667462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d0e8bb4-a3ec-4ec4-8886-4f28b6f3b125 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:09.668719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4d0e8bb4-a3ec-4ec4-8886-4f28b6f3b125 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:09.675565 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d0e8bb4-a3ec-4ec4-8886-4f28b6f3b125 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:09.676073 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d0e8bb4-a3ec-4ec4-8886-4f28b6f3b125 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:09.676577 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d0e8bb4-a3ec-4ec4-8886-4f28b6f3b125 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:09.677325 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d0e8bb4-a3ec-4ec4-8886-4f28b6f3b125 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:09.677782 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d0e8bb4-a3ec-4ec4-8886-4f28b6f3b125 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:09.678233 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d0e8bb4-a3ec-4ec4-8886-4f28b6f3b125 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:09.822496 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4d0e8bb4-a3ec-4ec4-8886-4f28b6f3b125 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:09.830912 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4d0e8bb4-a3ec-4ec4-8886-4f28b6f3b125 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:09.832344 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4d0e8bb4-a3ec-4ec4-8886-4f28b6f3b125 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:09.833528 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4d0e8bb4-a3ec-4ec4-8886-4f28b6f3b125 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1742 microversion: 2.20 time: 0.170061 Sep 17 21:13:09.834089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 427/840] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:09 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:10.860653 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-270b683d-420f-4af5-a8d7-0304310ce11f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:10.861289 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-270b683d-420f-4af5-a8d7-0304310ce11f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:10.867642 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-270b683d-420f-4af5-a8d7-0304310ce11f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:10.868119 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-270b683d-420f-4af5-a8d7-0304310ce11f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:10.868546 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-270b683d-420f-4af5-a8d7-0304310ce11f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:10.869257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-270b683d-420f-4af5-a8d7-0304310ce11f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:10.869706 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-270b683d-420f-4af5-a8d7-0304310ce11f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:10.870123 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-270b683d-420f-4af5-a8d7-0304310ce11f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:11.000378 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-270b683d-420f-4af5-a8d7-0304310ce11f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:11.008967 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-270b683d-420f-4af5-a8d7-0304310ce11f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:11.010395 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-270b683d-420f-4af5-a8d7-0304310ce11f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:11.011530 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-270b683d-420f-4af5-a8d7-0304310ce11f tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1742 microversion: 2.20 time: 0.154866 Sep 17 21:13:11.012078 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 414/841] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:10 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:11.776576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-20b87d37-c631-415f-80e8-5779177f0886 req-a679fc7e-a991-4d5e-99a4-951c1e9ae1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a67b77-200a-44df-918e-757ee2cae914", "name": "network-vif-plugged", "status": "completed", "tag": "26d391cd-62d3-4e74-b7fe-db22e47cae57"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:11.789106 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-20b87d37-c631-415f-80e8-5779177f0886 req-a679fc7e-a991-4d5e-99a4-951c1e9ae1ce service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:11.789589 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-20b87d37-c631-415f-80e8-5779177f0886 req-a679fc7e-a991-4d5e-99a4-951c1e9ae1ce service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:11.790022 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-20b87d37-c631-415f-80e8-5779177f0886 req-a679fc7e-a991-4d5e-99a4-951c1e9ae1ce service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:11.801044 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-20b87d37-c631-415f-80e8-5779177f0886 req-a679fc7e-a991-4d5e-99a4-951c1e9ae1ce service nova] Creating event network-vif-plugged:26d391cd-62d3-4e74-b7fe-db22e47cae57 for instance 60a67b77-200a-44df-918e-757ee2cae914 on hv-cinder-82651 Sep 17 21:13:11.806788 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-20b87d37-c631-415f-80e8-5779177f0886 req-a679fc7e-a991-4d5e-99a4-951c1e9ae1ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034846 Sep 17 21:13:11.807610 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 428/842] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:12.037198 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c28408e4-7fa9-4b88-9e0b-cf0a90f51379 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:12.037831 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c28408e4-7fa9-4b88-9e0b-cf0a90f51379 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:12.045672 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c28408e4-7fa9-4b88-9e0b-cf0a90f51379 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:12.046164 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c28408e4-7fa9-4b88-9e0b-cf0a90f51379 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:12.046595 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c28408e4-7fa9-4b88-9e0b-cf0a90f51379 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:12.047288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c28408e4-7fa9-4b88-9e0b-cf0a90f51379 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:12.047737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c28408e4-7fa9-4b88-9e0b-cf0a90f51379 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:12.048153 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c28408e4-7fa9-4b88-9e0b-cf0a90f51379 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:12.183422 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c28408e4-7fa9-4b88-9e0b-cf0a90f51379 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:12.194828 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c28408e4-7fa9-4b88-9e0b-cf0a90f51379 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:12.196310 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c28408e4-7fa9-4b88-9e0b-cf0a90f51379 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:12.197631 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c28408e4-7fa9-4b88-9e0b-cf0a90f51379 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1742 microversion: 2.20 time: 0.164574 Sep 17 21:13:12.198172 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 415/843] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:12 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:13.224254 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7c0d99b-9ad4-4073-9862-ca14bf3d2287 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:13.224968 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b7c0d99b-9ad4-4073-9862-ca14bf3d2287 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:13.232166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7c0d99b-9ad4-4073-9862-ca14bf3d2287 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:13.232698 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7c0d99b-9ad4-4073-9862-ca14bf3d2287 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:13.233147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7c0d99b-9ad4-4073-9862-ca14bf3d2287 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:13.233888 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7c0d99b-9ad4-4073-9862-ca14bf3d2287 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:13.234397 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7c0d99b-9ad4-4073-9862-ca14bf3d2287 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:13.234835 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7c0d99b-9ad4-4073-9862-ca14bf3d2287 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:13.362482 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b7c0d99b-9ad4-4073-9862-ca14bf3d2287 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:13.371131 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b7c0d99b-9ad4-4073-9862-ca14bf3d2287 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:13.372559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b7c0d99b-9ad4-4073-9862-ca14bf3d2287 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:13.373741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b7c0d99b-9ad4-4073-9862-ca14bf3d2287 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1742 microversion: 2.20 time: 0.154241 Sep 17 21:13:13.374292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 429/844] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:13 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:14.398908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60da64c0-1c34-4d14-b588-c7098a7b4017 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:14.399514 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-60da64c0-1c34-4d14-b588-c7098a7b4017 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:14.401598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:14.407152 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60da64c0-1c34-4d14-b588-c7098a7b4017 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:14.407634 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60da64c0-1c34-4d14-b588-c7098a7b4017 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:14.408065 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60da64c0-1c34-4d14-b588-c7098a7b4017 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:14.408773 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60da64c0-1c34-4d14-b588-c7098a7b4017 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:14.409227 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60da64c0-1c34-4d14-b588-c7098a7b4017 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:14.409646 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60da64c0-1c34-4d14-b588-c7098a7b4017 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:14.541571 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-60da64c0-1c34-4d14-b588-c7098a7b4017 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:14.549698 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-60da64c0-1c34-4d14-b588-c7098a7b4017 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:14.551142 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-60da64c0-1c34-4d14-b588-c7098a7b4017 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:14.552298 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60da64c0-1c34-4d14-b588-c7098a7b4017 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1742 microversion: 2.20 time: 0.157293 Sep 17 21:13:14.552870 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 416/845] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:14 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:15.583891 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ebcc49c3-9f57-473d-8278-29bfe3f17695 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:15.584509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ebcc49c3-9f57-473d-8278-29bfe3f17695 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:15.592250 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebcc49c3-9f57-473d-8278-29bfe3f17695 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:15.592893 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebcc49c3-9f57-473d-8278-29bfe3f17695 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:15.593528 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebcc49c3-9f57-473d-8278-29bfe3f17695 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:15.594279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebcc49c3-9f57-473d-8278-29bfe3f17695 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:15.594886 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebcc49c3-9f57-473d-8278-29bfe3f17695 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:15.595311 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebcc49c3-9f57-473d-8278-29bfe3f17695 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:15.739564 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ebcc49c3-9f57-473d-8278-29bfe3f17695 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:15.747796 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ebcc49c3-9f57-473d-8278-29bfe3f17695 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:15.749274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ebcc49c3-9f57-473d-8278-29bfe3f17695 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:15.750442 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ebcc49c3-9f57-473d-8278-29bfe3f17695 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.170987 Sep 17 21:13:15.751025 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 430/846] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:15 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:16.777010 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-125e58f3-5601-43db-b3fa-a77918f35b94 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:16.777748 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-125e58f3-5601-43db-b3fa-a77918f35b94 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:16.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-125e58f3-5601-43db-b3fa-a77918f35b94 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:16.785323 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-125e58f3-5601-43db-b3fa-a77918f35b94 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:16.785967 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-125e58f3-5601-43db-b3fa-a77918f35b94 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:16.786846 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-125e58f3-5601-43db-b3fa-a77918f35b94 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:16.787465 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-125e58f3-5601-43db-b3fa-a77918f35b94 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:16.787886 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-125e58f3-5601-43db-b3fa-a77918f35b94 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:16.928245 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-125e58f3-5601-43db-b3fa-a77918f35b94 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:16.941949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-125e58f3-5601-43db-b3fa-a77918f35b94 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:16.943651 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-125e58f3-5601-43db-b3fa-a77918f35b94 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:16.946951 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-125e58f3-5601-43db-b3fa-a77918f35b94 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.173685 Sep 17 21:13:16.948617 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 417/847] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:16 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:17.973123 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b80f0d49-85b0-4589-b54c-05a7f7a19077 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:17.973953 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b80f0d49-85b0-4589-b54c-05a7f7a19077 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:17.980633 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b80f0d49-85b0-4589-b54c-05a7f7a19077 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:17.981235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b80f0d49-85b0-4589-b54c-05a7f7a19077 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:17.981672 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b80f0d49-85b0-4589-b54c-05a7f7a19077 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:17.982374 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b80f0d49-85b0-4589-b54c-05a7f7a19077 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:17.982826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b80f0d49-85b0-4589-b54c-05a7f7a19077 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:17.983246 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b80f0d49-85b0-4589-b54c-05a7f7a19077 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:18.119598 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b80f0d49-85b0-4589-b54c-05a7f7a19077 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:18.128930 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b80f0d49-85b0-4589-b54c-05a7f7a19077 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:18.130393 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b80f0d49-85b0-4589-b54c-05a7f7a19077 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:18.131535 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b80f0d49-85b0-4589-b54c-05a7f7a19077 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.162322 Sep 17 21:13:18.132082 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 431/848] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:17 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:19.157854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7f1accd6-01fb-4299-a329-2b3b5800df5e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:19.158375 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7f1accd6-01fb-4299-a329-2b3b5800df5e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:19.164615 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f1accd6-01fb-4299-a329-2b3b5800df5e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:19.165118 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f1accd6-01fb-4299-a329-2b3b5800df5e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:19.165544 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f1accd6-01fb-4299-a329-2b3b5800df5e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:19.166223 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f1accd6-01fb-4299-a329-2b3b5800df5e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:19.166697 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f1accd6-01fb-4299-a329-2b3b5800df5e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:19.167127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f1accd6-01fb-4299-a329-2b3b5800df5e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:19.298498 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7f1accd6-01fb-4299-a329-2b3b5800df5e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:19.307323 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7f1accd6-01fb-4299-a329-2b3b5800df5e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:19.309038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7f1accd6-01fb-4299-a329-2b3b5800df5e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:19.310123 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7f1accd6-01fb-4299-a329-2b3b5800df5e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.156288 Sep 17 21:13:19.310682 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 418/849] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:19 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:20.337007 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2acba7a-5949-49c4-bb32-ad66ec80daa2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:20.337612 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a2acba7a-5949-49c4-bb32-ad66ec80daa2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:20.345020 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2acba7a-5949-49c4-bb32-ad66ec80daa2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:20.345508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2acba7a-5949-49c4-bb32-ad66ec80daa2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:20.345979 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2acba7a-5949-49c4-bb32-ad66ec80daa2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:20.346683 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2acba7a-5949-49c4-bb32-ad66ec80daa2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:20.347136 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2acba7a-5949-49c4-bb32-ad66ec80daa2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:20.347805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2acba7a-5949-49c4-bb32-ad66ec80daa2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:20.480538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a2acba7a-5949-49c4-bb32-ad66ec80daa2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:20.489044 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a2acba7a-5949-49c4-bb32-ad66ec80daa2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:20.490497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a2acba7a-5949-49c4-bb32-ad66ec80daa2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:20.491653 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a2acba7a-5949-49c4-bb32-ad66ec80daa2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.158597 Sep 17 21:13:20.492205 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 432/850] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:20 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:20.727073 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d015ed0-400d-41b6-bbc0-005dce8b2ee6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:20.727632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d015ed0-400d-41b6-bbc0-005dce8b2ee6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:20.734373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d015ed0-400d-41b6-bbc0-005dce8b2ee6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:20.735153 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d015ed0-400d-41b6-bbc0-005dce8b2ee6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:20.735745 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d015ed0-400d-41b6-bbc0-005dce8b2ee6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:20.736935 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d015ed0-400d-41b6-bbc0-005dce8b2ee6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:20.737394 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d015ed0-400d-41b6-bbc0-005dce8b2ee6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:20.737946 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d015ed0-400d-41b6-bbc0-005dce8b2ee6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:20.762576 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d015ed0-400d-41b6-bbc0-005dce8b2ee6 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/ips" status: 200 len: 146 microversion: 2.1 time: 0.038462 Sep 17 21:13:20.766254 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 419/851] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 17 21:13:20 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:21.518237 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d9f51de-f1f7-4880-b165-214167a63778 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:21.519018 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9d9f51de-f1f7-4880-b165-214167a63778 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:21.525293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d9f51de-f1f7-4880-b165-214167a63778 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:21.525771 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d9f51de-f1f7-4880-b165-214167a63778 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:21.526199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d9f51de-f1f7-4880-b165-214167a63778 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:21.526884 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d9f51de-f1f7-4880-b165-214167a63778 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:21.527332 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d9f51de-f1f7-4880-b165-214167a63778 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:21.527799 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d9f51de-f1f7-4880-b165-214167a63778 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:21.668309 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9d9f51de-f1f7-4880-b165-214167a63778 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:21.677676 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9d9f51de-f1f7-4880-b165-214167a63778 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:21.679466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9d9f51de-f1f7-4880-b165-214167a63778 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:21.680643 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9d9f51de-f1f7-4880-b165-214167a63778 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.167774 Sep 17 21:13:21.681384 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 433/852] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:21 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:22.143915 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-776fbcbf-7295-485e-b61f-01a2fc4b1cbd tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ca8436e-02e3-405f-8201-cafd4af6791d"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:22.146916 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-776fbcbf-7295-485e-b61f-01a2fc4b1cbd tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.153528 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-776fbcbf-7295-485e-b61f-01a2fc4b1cbd tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.154116 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-776fbcbf-7295-485e-b61f-01a2fc4b1cbd tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.154553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-776fbcbf-7295-485e-b61f-01a2fc4b1cbd tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.155246 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-776fbcbf-7295-485e-b61f-01a2fc4b1cbd tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.155701 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-776fbcbf-7295-485e-b61f-01a2fc4b1cbd tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.156124 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-776fbcbf-7295-485e-b61f-01a2fc4b1cbd tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.407913 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-776fbcbf-7295-485e-b61f-01a2fc4b1cbd tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "POST /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267779 Sep 17 21:13:22.408507 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 420/853] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:13:22 2022] POST /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:13:22.707467 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-643e564a-cd3a-440f-8482-25cd49753269 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.708053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-643e564a-cd3a-440f-8482-25cd49753269 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.714223 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-643e564a-cd3a-440f-8482-25cd49753269 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.714703 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-643e564a-cd3a-440f-8482-25cd49753269 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.715139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-643e564a-cd3a-440f-8482-25cd49753269 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.716175 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-643e564a-cd3a-440f-8482-25cd49753269 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.716842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-643e564a-cd3a-440f-8482-25cd49753269 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.717420 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-643e564a-cd3a-440f-8482-25cd49753269 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.854377 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-643e564a-cd3a-440f-8482-25cd49753269 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:22.863647 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-643e564a-cd3a-440f-8482-25cd49753269 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:22.865127 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-643e564a-cd3a-440f-8482-25cd49753269 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:22.866490 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-643e564a-cd3a-440f-8482-25cd49753269 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.162942 Sep 17 21:13:22.867050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 434/854] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:22 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:23.894034 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e74a03a-6d31-49db-8f4a-ba9646b9caa1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:23.895590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e74a03a-6d31-49db-8f4a-ba9646b9caa1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:23.901967 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e74a03a-6d31-49db-8f4a-ba9646b9caa1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:23.905379 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e74a03a-6d31-49db-8f4a-ba9646b9caa1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:23.905834 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e74a03a-6d31-49db-8f4a-ba9646b9caa1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:23.906560 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e74a03a-6d31-49db-8f4a-ba9646b9caa1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:23.907020 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e74a03a-6d31-49db-8f4a-ba9646b9caa1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:23.907464 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e74a03a-6d31-49db-8f4a-ba9646b9caa1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:23.927928 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:24.140336 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e74a03a-6d31-49db-8f4a-ba9646b9caa1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:24.163945 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e74a03a-6d31-49db-8f4a-ba9646b9caa1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:24.163945 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e74a03a-6d31-49db-8f4a-ba9646b9caa1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:24.163945 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e74a03a-6d31-49db-8f4a-ba9646b9caa1 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.272537 Sep 17 21:13:24.177393 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 421/855] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:23 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:25.191964 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0366fad-f72e-4d19-9813-33a6d198cf9a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:25.192568 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0366fad-f72e-4d19-9813-33a6d198cf9a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:25.195486 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=31 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:25.202083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0366fad-f72e-4d19-9813-33a6d198cf9a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:25.202681 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0366fad-f72e-4d19-9813-33a6d198cf9a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:25.203955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0366fad-f72e-4d19-9813-33a6d198cf9a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:25.204917 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0366fad-f72e-4d19-9813-33a6d198cf9a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:25.205682 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0366fad-f72e-4d19-9813-33a6d198cf9a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:25.206422 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0366fad-f72e-4d19-9813-33a6d198cf9a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:25.211616 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=85 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:25.350755 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0366fad-f72e-4d19-9813-33a6d198cf9a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:25.360006 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0366fad-f72e-4d19-9813-33a6d198cf9a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:25.361475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0366fad-f72e-4d19-9813-33a6d198cf9a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:25.362684 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0366fad-f72e-4d19-9813-33a6d198cf9a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.175236 Sep 17 21:13:25.366050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 435/856] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:25 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:26.392493 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f92fed2d-6c9f-4b44-8bf3-1af7e401afbb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:26.394278 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f92fed2d-6c9f-4b44-8bf3-1af7e401afbb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:26.396844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:26.403081 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f92fed2d-6c9f-4b44-8bf3-1af7e401afbb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:26.404476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f92fed2d-6c9f-4b44-8bf3-1af7e401afbb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:26.405171 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f92fed2d-6c9f-4b44-8bf3-1af7e401afbb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:26.406389 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f92fed2d-6c9f-4b44-8bf3-1af7e401afbb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:26.406849 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f92fed2d-6c9f-4b44-8bf3-1af7e401afbb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:26.407437 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f92fed2d-6c9f-4b44-8bf3-1af7e401afbb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:26.412508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1554242073", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-70796160", "security_groups": [{"name": "tempest-secgroup-smoke-1359094004"}], "block_device_mapping_v2": [{"uuid": "fb3b767d-9b68-411c-ac11-6d567cb39458", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "39daaa91-156d-400a-8598-b2da78c5f62e"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:26.573898 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] validate_networks() for [('39daaa91-156d-400a-8598-b2da78c5f62e', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:13:26.582619 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f92fed2d-6c9f-4b44-8bf3-1af7e401afbb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:26.595043 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f92fed2d-6c9f-4b44-8bf3-1af7e401afbb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:26.596810 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f92fed2d-6c9f-4b44-8bf3-1af7e401afbb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:26.599972 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f92fed2d-6c9f-4b44-8bf3-1af7e401afbb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.212410 Sep 17 21:13:26.605533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 422/857] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:26 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:27.237450 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:13:27.238375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:13:27.239282 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:13:27.239986 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:13:27.240845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:13:27.252888 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:27.253413 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:27.253871 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:27.254684 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:27.255488 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:27.255732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:27.273408 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Getting quotas for project f58304cb0e1a42ce9bbc5ea8a3e58899. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:13:27.277387 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Getting quotas for user 91f2a01f833d4751a6f81d6a8f11b8ed and project f58304cb0e1a42ce9bbc5ea8a3e58899. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:13:27.347740 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:13:27.350048 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb3b767d-9b68-411c-ac11-6d567cb39458',volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:13:27.509305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-efcf0c3f-b4f2-4d81-93eb-523913d0c41a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.101776 Sep 17 21:13:27.510148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 436/858] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:13:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:13:27.522226 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5a51e2b9-f519-49dc-b104-e4084c7156f6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:27.522849 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5a51e2b9-f519-49dc-b104-e4084c7156f6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:27.602576 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5a51e2b9-f519-49dc-b104-e4084c7156f6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:27.610800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5a51e2b9-f519-49dc-b104-e4084c7156f6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1093 microversion: 2.1 time: 0.092822 Sep 17 21:13:27.627405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 423/859] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:27 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1093 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:27.631253 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3134f0b6-54c9-4b72-a550-e5e628a696c8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:27.631885 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3134f0b6-54c9-4b72-a550-e5e628a696c8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:27.638080 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3134f0b6-54c9-4b72-a550-e5e628a696c8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:27.638565 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3134f0b6-54c9-4b72-a550-e5e628a696c8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:27.638998 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3134f0b6-54c9-4b72-a550-e5e628a696c8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:27.639699 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3134f0b6-54c9-4b72-a550-e5e628a696c8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:27.640147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3134f0b6-54c9-4b72-a550-e5e628a696c8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:27.640565 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3134f0b6-54c9-4b72-a550-e5e628a696c8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:27.846126 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3134f0b6-54c9-4b72-a550-e5e628a696c8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:27.855636 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3134f0b6-54c9-4b72-a550-e5e628a696c8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:27.857512 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3134f0b6-54c9-4b72-a550-e5e628a696c8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:27.858702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3134f0b6-54c9-4b72-a550-e5e628a696c8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.231241 Sep 17 21:13:27.859770 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 437/860] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:27 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:28.640698 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-69ac7dac-8a93-4cee-b788-44ee8f8cd928 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:28.641332 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-69ac7dac-8a93-4cee-b788-44ee8f8cd928 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:28.650645 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69ac7dac-8a93-4cee-b788-44ee8f8cd928 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:28.651329 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69ac7dac-8a93-4cee-b788-44ee8f8cd928 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:28.652032 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69ac7dac-8a93-4cee-b788-44ee8f8cd928 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:28.652991 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69ac7dac-8a93-4cee-b788-44ee8f8cd928 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:28.653674 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69ac7dac-8a93-4cee-b788-44ee8f8cd928 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:28.654292 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69ac7dac-8a93-4cee-b788-44ee8f8cd928 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:28.746391 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-69ac7dac-8a93-4cee-b788-44ee8f8cd928 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:28.755624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-69ac7dac-8a93-4cee-b788-44ee8f8cd928 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1143 microversion: 2.1 time: 0.119616 Sep 17 21:13:28.756189 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 424/861] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:28 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1143 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:28.895542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-38cfd2eb-2f13-4c29-9a70-e6cdaea4ff63 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:28.896336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-38cfd2eb-2f13-4c29-9a70-e6cdaea4ff63 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:28.903552 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38cfd2eb-2f13-4c29-9a70-e6cdaea4ff63 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:28.903983 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38cfd2eb-2f13-4c29-9a70-e6cdaea4ff63 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:28.904412 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38cfd2eb-2f13-4c29-9a70-e6cdaea4ff63 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:28.905385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38cfd2eb-2f13-4c29-9a70-e6cdaea4ff63 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:28.905843 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38cfd2eb-2f13-4c29-9a70-e6cdaea4ff63 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:28.906265 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38cfd2eb-2f13-4c29-9a70-e6cdaea4ff63 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:29.058294 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-38cfd2eb-2f13-4c29-9a70-e6cdaea4ff63 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:29.068961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-38cfd2eb-2f13-4c29-9a70-e6cdaea4ff63 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:29.070466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-38cfd2eb-2f13-4c29-9a70-e6cdaea4ff63 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:29.072038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-38cfd2eb-2f13-4c29-9a70-e6cdaea4ff63 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.180517 Sep 17 21:13:29.085089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 438/862] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:28 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:29.780006 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-72995715-8d3b-4bdb-bc36-e7458e83994b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:29.781447 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-72995715-8d3b-4bdb-bc36-e7458e83994b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:29.789806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72995715-8d3b-4bdb-bc36-e7458e83994b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:29.790750 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72995715-8d3b-4bdb-bc36-e7458e83994b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:29.792530 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72995715-8d3b-4bdb-bc36-e7458e83994b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:29.793722 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72995715-8d3b-4bdb-bc36-e7458e83994b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:29.794284 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72995715-8d3b-4bdb-bc36-e7458e83994b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:29.795018 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72995715-8d3b-4bdb-bc36-e7458e83994b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:29.883856 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-72995715-8d3b-4bdb-bc36-e7458e83994b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:29.899782 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-72995715-8d3b-4bdb-bc36-e7458e83994b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1209 microversion: 2.1 time: 0.124173 Sep 17 21:13:29.913058 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 425/863] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:29 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1209 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:30.037228 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1c11806b-8b7a-4154-8f0e-03b4eab5893a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:30.039594 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1c11806b-8b7a-4154-8f0e-03b4eab5893a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:30.046677 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1c11806b-8b7a-4154-8f0e-03b4eab5893a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:30.047154 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1c11806b-8b7a-4154-8f0e-03b4eab5893a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:30.047587 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1c11806b-8b7a-4154-8f0e-03b4eab5893a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:30.048363 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1c11806b-8b7a-4154-8f0e-03b4eab5893a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:30.048844 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1c11806b-8b7a-4154-8f0e-03b4eab5893a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:30.049268 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1c11806b-8b7a-4154-8f0e-03b4eab5893a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:30.078501 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1c11806b-8b7a-4154-8f0e-03b4eab5893a tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Sep 17 21:13:30.079062 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 439/864] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:13:30 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:30.089954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e2a7b88b-83b9-4030-bc53-917532d5c1b9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:30.090437 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e2a7b88b-83b9-4030-bc53-917532d5c1b9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:30.097174 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2a7b88b-83b9-4030-bc53-917532d5c1b9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:30.097749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2a7b88b-83b9-4030-bc53-917532d5c1b9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:30.098591 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2a7b88b-83b9-4030-bc53-917532d5c1b9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:30.099006 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e182c765-189b-4357-b06b-49899d72317b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:30.099130 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2a7b88b-83b9-4030-bc53-917532d5c1b9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:30.099606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e182c765-189b-4357-b06b-49899d72317b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:30.099719 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2a7b88b-83b9-4030-bc53-917532d5c1b9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:30.100173 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2a7b88b-83b9-4030-bc53-917532d5c1b9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:30.106025 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e182c765-189b-4357-b06b-49899d72317b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:30.106588 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e182c765-189b-4357-b06b-49899d72317b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:30.108088 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e182c765-189b-4357-b06b-49899d72317b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:30.108477 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e182c765-189b-4357-b06b-49899d72317b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:30.109053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e182c765-189b-4357-b06b-49899d72317b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:30.109545 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e182c765-189b-4357-b06b-49899d72317b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:30.133150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e2a7b88b-83b9-4030-bc53-917532d5c1b9 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments/5ca8436e-02e3-405f-8201-cafd4af6791d" status: 200 len: 194 microversion: 2.1 time: 0.047020 Sep 17 21:13:30.140189 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 426/865] 10.222.0.16 () {58 vars in 1413 bytes} [Sat Sep 17 21:13:30 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments/5ca8436e-02e3-405f-8201-cafd4af6791d => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:13:30.343398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e182c765-189b-4357-b06b-49899d72317b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:30.354959 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e182c765-189b-4357-b06b-49899d72317b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:30.358354 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e182c765-189b-4357-b06b-49899d72317b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:30.362532 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e182c765-189b-4357-b06b-49899d72317b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1737 microversion: 2.20 time: 0.267653 Sep 17 21:13:30.363321 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 440/866] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:30 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1737 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:30.923674 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-025870a6-f13a-4135-8418-dd769ba395b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:30.924962 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-025870a6-f13a-4135-8418-dd769ba395b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:30.933657 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-025870a6-f13a-4135-8418-dd769ba395b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:30.934393 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-025870a6-f13a-4135-8418-dd769ba395b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:30.935697 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-025870a6-f13a-4135-8418-dd769ba395b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:30.936759 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-025870a6-f13a-4135-8418-dd769ba395b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:30.937418 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-025870a6-f13a-4135-8418-dd769ba395b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:30.938019 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-025870a6-f13a-4135-8418-dd769ba395b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:31.169406 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-025870a6-f13a-4135-8418-dd769ba395b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:31.177415 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-025870a6-f13a-4135-8418-dd769ba395b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.257811 Sep 17 21:13:31.177979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 427/867] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:30 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:31.391431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f952652e-9732-4bd8-913d-0c8001b57afb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:31.392093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f952652e-9732-4bd8-913d-0c8001b57afb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:31.399575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f952652e-9732-4bd8-913d-0c8001b57afb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:31.400082 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f952652e-9732-4bd8-913d-0c8001b57afb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:31.400616 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f952652e-9732-4bd8-913d-0c8001b57afb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:31.401359 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f952652e-9732-4bd8-913d-0c8001b57afb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:31.401794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f952652e-9732-4bd8-913d-0c8001b57afb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:31.402211 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f952652e-9732-4bd8-913d-0c8001b57afb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:31.539313 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ab847f3f-f993-46c7-8a94-3f19427f60eb tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "747a15b2-8d54-405b-baa7-3aa9da0a7fbb"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:31.542190 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ab847f3f-f993-46c7-8a94-3f19427f60eb tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:31.548723 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab847f3f-f993-46c7-8a94-3f19427f60eb tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:31.549212 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab847f3f-f993-46c7-8a94-3f19427f60eb tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:31.549793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab847f3f-f993-46c7-8a94-3f19427f60eb tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:31.550491 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab847f3f-f993-46c7-8a94-3f19427f60eb tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:31.550941 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab847f3f-f993-46c7-8a94-3f19427f60eb tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:31.551360 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab847f3f-f993-46c7-8a94-3f19427f60eb tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:31.618345 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f952652e-9732-4bd8-913d-0c8001b57afb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:31.626959 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f952652e-9732-4bd8-913d-0c8001b57afb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:31.628393 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f952652e-9732-4bd8-913d-0c8001b57afb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:31.629616 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f952652e-9732-4bd8-913d-0c8001b57afb tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1719 microversion: 2.20 time: 0.243973 Sep 17 21:13:31.630183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 441/868] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:31 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1719 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:31.634521 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-116ab9cb-5561-4f35-969e-47657004032e req-abdb2fa7-c919-46be-b003-3e49f193f33c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c20c116-f378-4a7e-812b-45a6824e98ad", "tag": "4c335199-6467-42cd-bd0e-cd87c9b1dac8"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:31.643870 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-116ab9cb-5561-4f35-969e-47657004032e req-abdb2fa7-c919-46be-b003-3e49f193f33c service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:31.644277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-116ab9cb-5561-4f35-969e-47657004032e req-abdb2fa7-c919-46be-b003-3e49f193f33c service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:31.644723 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-116ab9cb-5561-4f35-969e-47657004032e req-abdb2fa7-c919-46be-b003-3e49f193f33c service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:31.655867 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-116ab9cb-5561-4f35-969e-47657004032e req-abdb2fa7-c919-46be-b003-3e49f193f33c service nova] Creating event network-changed:4c335199-6467-42cd-bd0e-cd87c9b1dac8 for instance 0c20c116-f378-4a7e-812b-45a6824e98ad on hv-cinder-82651 Sep 17 21:13:31.660644 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-116ab9cb-5561-4f35-969e-47657004032e req-abdb2fa7-c919-46be-b003-3e49f193f33c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029344 Sep 17 21:13:31.661247 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 442/869] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:32.201836 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e3e9905-d593-4802-954d-3ce6ca7bfaf4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:32.202531 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3e3e9905-d593-4802-954d-3ce6ca7bfaf4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:32.208640 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e3e9905-d593-4802-954d-3ce6ca7bfaf4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:32.209141 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e3e9905-d593-4802-954d-3ce6ca7bfaf4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:32.209573 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e3e9905-d593-4802-954d-3ce6ca7bfaf4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:32.210286 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e3e9905-d593-4802-954d-3ce6ca7bfaf4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:32.210735 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e3e9905-d593-4802-954d-3ce6ca7bfaf4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:32.211154 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e3e9905-d593-4802-954d-3ce6ca7bfaf4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:32.349153 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3e3e9905-d593-4802-954d-3ce6ca7bfaf4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:32.356754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3e3e9905-d593-4802-954d-3ce6ca7bfaf4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.159817 Sep 17 21:13:32.357318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 443/870] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:32 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:32.655784 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-43a3788f-8384-46fb-ae00-078531579dda tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:32.656416 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-43a3788f-8384-46fb-ae00-078531579dda tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:32.662659 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a3788f-8384-46fb-ae00-078531579dda tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:32.663137 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a3788f-8384-46fb-ae00-078531579dda tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:32.663569 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a3788f-8384-46fb-ae00-078531579dda tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:32.664260 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a3788f-8384-46fb-ae00-078531579dda tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:32.664738 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a3788f-8384-46fb-ae00-078531579dda tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:32.665165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a3788f-8384-46fb-ae00-078531579dda tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:32.797803 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-43a3788f-8384-46fb-ae00-078531579dda tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:32.806148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-43a3788f-8384-46fb-ae00-078531579dda tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:32.807818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-43a3788f-8384-46fb-ae00-078531579dda tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:32.809009 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-43a3788f-8384-46fb-ae00-078531579dda tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1719 microversion: 2.20 time: 0.157479 Sep 17 21:13:32.809575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 444/871] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:32 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:32.969321 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ab847f3f-f993-46c7-8a94-3f19427f60eb tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "POST /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.435040 Sep 17 21:13:32.970016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 428/872] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:13:31 2022] POST /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments => generated 194 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:13:33.379231 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aca5e6ef-d596-46b4-9cf1-ee270968d31e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:33.379839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aca5e6ef-d596-46b4-9cf1-ee270968d31e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:33.385841 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aca5e6ef-d596-46b4-9cf1-ee270968d31e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:33.386301 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aca5e6ef-d596-46b4-9cf1-ee270968d31e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:33.386760 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aca5e6ef-d596-46b4-9cf1-ee270968d31e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:33.387450 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aca5e6ef-d596-46b4-9cf1-ee270968d31e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:33.388528 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aca5e6ef-d596-46b4-9cf1-ee270968d31e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:33.389396 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aca5e6ef-d596-46b4-9cf1-ee270968d31e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:33.523623 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-aca5e6ef-d596-46b4-9cf1-ee270968d31e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:33.532313 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aca5e6ef-d596-46b4-9cf1-ee270968d31e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.156867 Sep 17 21:13:33.533019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 445/873] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:33 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:33.836362 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b05c9c9-884b-43d4-8ec8-434b2e7a3633 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:33.837099 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b05c9c9-884b-43d4-8ec8-434b2e7a3633 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:33.843724 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b05c9c9-884b-43d4-8ec8-434b2e7a3633 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:33.844203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b05c9c9-884b-43d4-8ec8-434b2e7a3633 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:33.844632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b05c9c9-884b-43d4-8ec8-434b2e7a3633 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:33.845665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b05c9c9-884b-43d4-8ec8-434b2e7a3633 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:33.846116 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b05c9c9-884b-43d4-8ec8-434b2e7a3633 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:33.846534 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b05c9c9-884b-43d4-8ec8-434b2e7a3633 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:33.977555 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b05c9c9-884b-43d4-8ec8-434b2e7a3633 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:33.986814 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b05c9c9-884b-43d4-8ec8-434b2e7a3633 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:33.988260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b05c9c9-884b-43d4-8ec8-434b2e7a3633 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:33.989466 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b05c9c9-884b-43d4-8ec8-434b2e7a3633 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1662 microversion: 2.20 time: 0.157838 Sep 17 21:13:33.990021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 429/874] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:33 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:34.014716 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a102d45-10f7-4956-9ede-167e826bee18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01cfbe35-b111-43a3-9873-affb0478c6f7"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:34.017096 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a102d45-10f7-4956-9ede-167e826bee18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:34.023449 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a102d45-10f7-4956-9ede-167e826bee18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:34.023934 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a102d45-10f7-4956-9ede-167e826bee18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:34.024372 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a102d45-10f7-4956-9ede-167e826bee18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:34.025124 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a102d45-10f7-4956-9ede-167e826bee18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:34.025583 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a102d45-10f7-4956-9ede-167e826bee18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:34.026010 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a102d45-10f7-4956-9ede-167e826bee18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:34.288405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a102d45-10f7-4956-9ede-167e826bee18 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "POST /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.277823 Sep 17 21:13:34.289079 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 446/875] 10.222.0.16 () {62 vars in 1364 bytes} [Sat Sep 17 21:13:34 2022] POST /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/os-volume_attachments => generated 188 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:13:34.413526 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dc017d0-e915-4b14-8827-643b4597d053 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:34.414025 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9dc017d0-e915-4b14-8827-643b4597d053 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:34.421057 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dc017d0-e915-4b14-8827-643b4597d053 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:34.421543 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dc017d0-e915-4b14-8827-643b4597d053 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:34.421981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dc017d0-e915-4b14-8827-643b4597d053 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:34.422671 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dc017d0-e915-4b14-8827-643b4597d053 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:34.423410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dc017d0-e915-4b14-8827-643b4597d053 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:34.423838 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dc017d0-e915-4b14-8827-643b4597d053 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:34.558272 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-130ec3b6-b8f9-4328-8c1c-2e3401556d44 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:34.559087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-130ec3b6-b8f9-4328-8c1c-2e3401556d44 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:34.565220 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-130ec3b6-b8f9-4328-8c1c-2e3401556d44 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:34.565957 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-130ec3b6-b8f9-4328-8c1c-2e3401556d44 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:34.566387 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-130ec3b6-b8f9-4328-8c1c-2e3401556d44 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:34.567080 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-130ec3b6-b8f9-4328-8c1c-2e3401556d44 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:34.567529 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-130ec3b6-b8f9-4328-8c1c-2e3401556d44 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:34.567985 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-130ec3b6-b8f9-4328-8c1c-2e3401556d44 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:34.664687 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9dc017d0-e915-4b14-8827-643b4597d053 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/os-volume_attachments/01cfbe35-b111-43a3-9873-affb0478c6f7" status: 202 len: 0 microversion: 2.20 time: 0.254972 Sep 17 21:13:34.665302 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 430/876] 10.222.0.16 () {60 vars in 1457 bytes} [Sat Sep 17 21:13:34 2022] DELETE /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/os-volume_attachments/01cfbe35-b111-43a3-9873-affb0478c6f7 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:13:34.701547 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-130ec3b6-b8f9-4328-8c1c-2e3401556d44 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:34.709234 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-130ec3b6-b8f9-4328-8c1c-2e3401556d44 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.157418 Sep 17 21:13:34.709781 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 447/877] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:34 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:34.727954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b9b167d0-25ce-4612-b7d4-8f6e449a6fbc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:34.728535 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b9b167d0-25ce-4612-b7d4-8f6e449a6fbc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:34.735610 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9b167d0-25ce-4612-b7d4-8f6e449a6fbc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:34.736087 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9b167d0-25ce-4612-b7d4-8f6e449a6fbc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:34.736516 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9b167d0-25ce-4612-b7d4-8f6e449a6fbc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:34.737232 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9b167d0-25ce-4612-b7d4-8f6e449a6fbc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:34.737678 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9b167d0-25ce-4612-b7d4-8f6e449a6fbc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:34.738094 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9b167d0-25ce-4612-b7d4-8f6e449a6fbc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:34.781026 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b9b167d0-25ce-4612-b7d4-8f6e449a6fbc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120588) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 17 21:13:34.845706 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b9b167d0-25ce-4612-b7d4-8f6e449a6fbc tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "POST /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/action" status: 202 len: 0 microversion: 2.20 time: 0.121508 Sep 17 21:13:34.846217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 431/878] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 17 21:13:34 2022] POST /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:13:34.854163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-30546ca0-c3c7-456b-9c8b-7215f74a6b3e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:34.854774 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-30546ca0-c3c7-456b-9c8b-7215f74a6b3e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:34.861353 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30546ca0-c3c7-456b-9c8b-7215f74a6b3e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:34.861840 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30546ca0-c3c7-456b-9c8b-7215f74a6b3e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:34.862274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30546ca0-c3c7-456b-9c8b-7215f74a6b3e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:34.862980 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30546ca0-c3c7-456b-9c8b-7215f74a6b3e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:34.863431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30546ca0-c3c7-456b-9c8b-7215f74a6b3e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:34.863855 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30546ca0-c3c7-456b-9c8b-7215f74a6b3e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:34.993940 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-30546ca0-c3c7-456b-9c8b-7215f74a6b3e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:35.002980 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-30546ca0-c3c7-456b-9c8b-7215f74a6b3e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:35.004470 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-30546ca0-c3c7-456b-9c8b-7215f74a6b3e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:35.005663 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-30546ca0-c3c7-456b-9c8b-7215f74a6b3e tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1670 microversion: 2.20 time: 0.155316 Sep 17 21:13:35.006215 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 448/879] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:34 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:35.734701 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-768ae679-8019-4fec-880a-eeee85627da6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:35.735383 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-768ae679-8019-4fec-880a-eeee85627da6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:35.741470 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-768ae679-8019-4fec-880a-eeee85627da6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:35.741965 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-768ae679-8019-4fec-880a-eeee85627da6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:35.742524 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-768ae679-8019-4fec-880a-eeee85627da6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:35.743232 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-768ae679-8019-4fec-880a-eeee85627da6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:35.743732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-768ae679-8019-4fec-880a-eeee85627da6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:35.744120 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-768ae679-8019-4fec-880a-eeee85627da6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:35.839633 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c0ed5f54-7047-4910-a8ff-5a79860b1ee8 req-32ac997b-5e47-456d-a680-30130623e153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a67b77-200a-44df-918e-757ee2cae914", "name": "network-vif-unplugged", "status": "completed", "tag": "26d391cd-62d3-4e74-b7fe-db22e47cae57"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:35.850640 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c0ed5f54-7047-4910-a8ff-5a79860b1ee8 req-32ac997b-5e47-456d-a680-30130623e153 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:35.851611 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c0ed5f54-7047-4910-a8ff-5a79860b1ee8 req-32ac997b-5e47-456d-a680-30130623e153 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:35.852262 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c0ed5f54-7047-4910-a8ff-5a79860b1ee8 req-32ac997b-5e47-456d-a680-30130623e153 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:35.865878 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.compute.server_external_events [req-c0ed5f54-7047-4910-a8ff-5a79860b1ee8 req-32ac997b-5e47-456d-a680-30130623e153 service nova] Unable to find a host for instance 60a67b77-200a-44df-918e-757ee2cae914. Dropping event network-vif-unplugged {{(pid=120587) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 17 21:13:35.867054 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c0ed5f54-7047-4910-a8ff-5a79860b1ee8 req-32ac997b-5e47-456d-a680-30130623e153 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033331 Sep 17 21:13:35.868137 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 449/880] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 17 21:13:35.908001 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-768ae679-8019-4fec-880a-eeee85627da6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:35.916073 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-768ae679-8019-4fec-880a-eeee85627da6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.185987 Sep 17 21:13:35.916997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 432/881] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:35 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:36.031311 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e799b81e-5937-4a6f-b344-455069d56684 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:36.031916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e799b81e-5937-4a6f-b344-455069d56684 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:36.037917 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e799b81e-5937-4a6f-b344-455069d56684 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:36.038397 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e799b81e-5937-4a6f-b344-455069d56684 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:36.039134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e799b81e-5937-4a6f-b344-455069d56684 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:36.039840 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e799b81e-5937-4a6f-b344-455069d56684 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:36.040296 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e799b81e-5937-4a6f-b344-455069d56684 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:36.040746 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e799b81e-5937-4a6f-b344-455069d56684 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:36.178208 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e799b81e-5937-4a6f-b344-455069d56684 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:36.187380 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e799b81e-5937-4a6f-b344-455069d56684 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:36.188867 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e799b81e-5937-4a6f-b344-455069d56684 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:36.190024 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e799b81e-5937-4a6f-b344-455069d56684 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.163286 Sep 17 21:13:36.190850 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 450/882] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:36 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:36.939308 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d738c82d-de11-4e40-b2e7-a67b52084538 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:36.940990 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d738c82d-de11-4e40-b2e7-a67b52084538 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:36.948197 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d738c82d-de11-4e40-b2e7-a67b52084538 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:36.948698 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d738c82d-de11-4e40-b2e7-a67b52084538 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:36.949139 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d738c82d-de11-4e40-b2e7-a67b52084538 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:36.949824 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d738c82d-de11-4e40-b2e7-a67b52084538 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:36.950531 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d738c82d-de11-4e40-b2e7-a67b52084538 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:36.950987 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d738c82d-de11-4e40-b2e7-a67b52084538 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:37.087800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d738c82d-de11-4e40-b2e7-a67b52084538 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:37.096377 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d738c82d-de11-4e40-b2e7-a67b52084538 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.160819 Sep 17 21:13:37.100706 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 433/883] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:36 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:37.217649 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9684f4bb-b7f8-40b9-b4f2-405b9836797a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:37.218128 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9684f4bb-b7f8-40b9-b4f2-405b9836797a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:37.225815 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9684f4bb-b7f8-40b9-b4f2-405b9836797a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:37.226745 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9684f4bb-b7f8-40b9-b4f2-405b9836797a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:37.227189 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9684f4bb-b7f8-40b9-b4f2-405b9836797a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:37.227910 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9684f4bb-b7f8-40b9-b4f2-405b9836797a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:37.228371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9684f4bb-b7f8-40b9-b4f2-405b9836797a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:37.228815 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9684f4bb-b7f8-40b9-b4f2-405b9836797a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:37.236035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:37.264604 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:37.299754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:37.432013 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9684f4bb-b7f8-40b9-b4f2-405b9836797a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:37.458942 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9684f4bb-b7f8-40b9-b4f2-405b9836797a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:37.460705 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9684f4bb-b7f8-40b9-b4f2-405b9836797a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:37.462084 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9684f4bb-b7f8-40b9-b4f2-405b9836797a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.249366 Sep 17 21:13:37.466414 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 451/884] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:37 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:38.120297 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d720ca56-9cc4-4b77-8587-ec527e00e46c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:38.120963 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d720ca56-9cc4-4b77-8587-ec527e00e46c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:38.127577 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:38.130663 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d720ca56-9cc4-4b77-8587-ec527e00e46c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:38.131387 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d720ca56-9cc4-4b77-8587-ec527e00e46c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:38.131828 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d720ca56-9cc4-4b77-8587-ec527e00e46c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:38.132546 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d720ca56-9cc4-4b77-8587-ec527e00e46c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:38.133278 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d720ca56-9cc4-4b77-8587-ec527e00e46c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:38.133886 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d720ca56-9cc4-4b77-8587-ec527e00e46c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:38.150338 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:38.381819 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d720ca56-9cc4-4b77-8587-ec527e00e46c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:38.391108 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d720ca56-9cc4-4b77-8587-ec527e00e46c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.274836 Sep 17 21:13:38.391685 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 434/885] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:38 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:38.492215 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-82463534-59ae-4836-8728-e59c68eff4d6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:38.492784 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-82463534-59ae-4836-8728-e59c68eff4d6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:38.500115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82463534-59ae-4836-8728-e59c68eff4d6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:38.500786 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82463534-59ae-4836-8728-e59c68eff4d6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:38.501215 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82463534-59ae-4836-8728-e59c68eff4d6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:38.501961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82463534-59ae-4836-8728-e59c68eff4d6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:38.502412 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82463534-59ae-4836-8728-e59c68eff4d6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:38.502999 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82463534-59ae-4836-8728-e59c68eff4d6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:38.664466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-82463534-59ae-4836-8728-e59c68eff4d6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:38.676754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-82463534-59ae-4836-8728-e59c68eff4d6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:38.678273 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-82463534-59ae-4836-8728-e59c68eff4d6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:38.679587 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-82463534-59ae-4836-8728-e59c68eff4d6 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.191288 Sep 17 21:13:38.680149 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 452/886] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:38 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:38.728985 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3bddca58-87a9-455c-990b-82adb53de46c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:38.729848 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3bddca58-87a9-455c-990b-82adb53de46c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:38.740270 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bddca58-87a9-455c-990b-82adb53de46c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:38.741469 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bddca58-87a9-455c-990b-82adb53de46c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:38.743592 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bddca58-87a9-455c-990b-82adb53de46c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:38.744582 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bddca58-87a9-455c-990b-82adb53de46c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:38.747863 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bddca58-87a9-455c-990b-82adb53de46c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:38.748115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-91e48890-4240-4059-99ff-5539557b710c req-1cde27df-6ea8-4811-b27b-d830a8095296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3209ceff-722f-437e-9ece-3f9542c1daa7", "tag": "9ec72a7a-4fab-4ddb-9a94-b4581d132104"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:38.748650 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bddca58-87a9-455c-990b-82adb53de46c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:38.766381 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-91e48890-4240-4059-99ff-5539557b710c req-1cde27df-6ea8-4811-b27b-d830a8095296 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:38.767243 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-91e48890-4240-4059-99ff-5539557b710c req-1cde27df-6ea8-4811-b27b-d830a8095296 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:38.767847 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-91e48890-4240-4059-99ff-5539557b710c req-1cde27df-6ea8-4811-b27b-d830a8095296 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:38.782325 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-91e48890-4240-4059-99ff-5539557b710c req-1cde27df-6ea8-4811-b27b-d830a8095296 service nova] Creating event network-changed:9ec72a7a-4fab-4ddb-9a94-b4581d132104 for instance 3209ceff-722f-437e-9ece-3f9542c1daa7 on hv-cinder-82651 Sep 17 21:13:38.787584 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-91e48890-4240-4059-99ff-5539557b710c req-1cde27df-6ea8-4811-b27b-d830a8095296 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053663 Sep 17 21:13:38.788845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 453/887] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:38.824782 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3bddca58-87a9-455c-990b-82adb53de46c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:13:38.985780 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3bddca58-87a9-455c-990b-82adb53de46c tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 204 len: 0 microversion: 2.1 time: 0.262099 Sep 17 21:13:38.986367 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 435/888] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:13:38 2022] DELETE /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:13:38.996046 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1e1cbe86-f1a8-4ba1-adb2-7d0a447398b2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:38.996847 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1e1cbe86-f1a8-4ba1-adb2-7d0a447398b2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:39.007966 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e1cbe86-f1a8-4ba1-adb2-7d0a447398b2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:39.008465 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e1cbe86-f1a8-4ba1-adb2-7d0a447398b2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:39.008956 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e1cbe86-f1a8-4ba1-adb2-7d0a447398b2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:39.009674 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e1cbe86-f1a8-4ba1-adb2-7d0a447398b2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:39.010365 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e1cbe86-f1a8-4ba1-adb2-7d0a447398b2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:39.010795 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e1cbe86-f1a8-4ba1-adb2-7d0a447398b2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:39.149067 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e1cbe86-f1a8-4ba1-adb2-7d0a447398b2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:39.157153 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1e1cbe86-f1a8-4ba1-adb2-7d0a447398b2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.165706 Sep 17 21:13:39.158289 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 454/889] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:38 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:39.417336 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1fd4977e-e287-4698-b248-84080a9c63c1 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:39.418026 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1fd4977e-e287-4698-b248-84080a9c63c1 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:39.424575 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fd4977e-e287-4698-b248-84080a9c63c1 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:39.425087 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fd4977e-e287-4698-b248-84080a9c63c1 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:39.425517 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fd4977e-e287-4698-b248-84080a9c63c1 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:39.426202 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fd4977e-e287-4698-b248-84080a9c63c1 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:39.426651 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fd4977e-e287-4698-b248-84080a9c63c1 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:39.427069 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fd4977e-e287-4698-b248-84080a9c63c1 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:39.708338 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d89731bf-d2ac-43c2-8ca9-7f191f9b94bf tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:39.709076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d89731bf-d2ac-43c2-8ca9-7f191f9b94bf tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:39.717184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d89731bf-d2ac-43c2-8ca9-7f191f9b94bf tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:39.717888 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d89731bf-d2ac-43c2-8ca9-7f191f9b94bf tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:39.718546 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d89731bf-d2ac-43c2-8ca9-7f191f9b94bf tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:39.719559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d89731bf-d2ac-43c2-8ca9-7f191f9b94bf tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:39.720237 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d89731bf-d2ac-43c2-8ca9-7f191f9b94bf tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:39.720894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d89731bf-d2ac-43c2-8ca9-7f191f9b94bf tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:39.759622 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1fd4977e-e287-4698-b248-84080a9c63c1 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:39.770461 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1fd4977e-e287-4698-b248-84080a9c63c1 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.357238 Sep 17 21:13:39.771754 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 436/890] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:39 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:39.889733 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d89731bf-d2ac-43c2-8ca9-7f191f9b94bf tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:39.898915 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d89731bf-d2ac-43c2-8ca9-7f191f9b94bf tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:39.900624 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d89731bf-d2ac-43c2-8ca9-7f191f9b94bf tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:39.902268 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d89731bf-d2ac-43c2-8ca9-7f191f9b94bf tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.197839 Sep 17 21:13:39.915917 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 455/891] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:39 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:40.180721 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc7cdbf2-2b0d-4edc-9714-5a734d50ac07 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:40.181264 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc7cdbf2-2b0d-4edc-9714-5a734d50ac07 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:40.188002 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc7cdbf2-2b0d-4edc-9714-5a734d50ac07 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:40.188486 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc7cdbf2-2b0d-4edc-9714-5a734d50ac07 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:40.188962 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc7cdbf2-2b0d-4edc-9714-5a734d50ac07 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:40.189654 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc7cdbf2-2b0d-4edc-9714-5a734d50ac07 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:40.190106 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc7cdbf2-2b0d-4edc-9714-5a734d50ac07 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:40.190801 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc7cdbf2-2b0d-4edc-9714-5a734d50ac07 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:40.345814 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fc7cdbf2-2b0d-4edc-9714-5a734d50ac07 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:40.353682 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc7cdbf2-2b0d-4edc-9714-5a734d50ac07 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.176916 Sep 17 21:13:40.354239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 437/892] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:40 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:40.796250 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85166d69-7607-46af-aa87-e5d886010458 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:40.796856 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85166d69-7607-46af-aa87-e5d886010458 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:40.803305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85166d69-7607-46af-aa87-e5d886010458 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:40.803788 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85166d69-7607-46af-aa87-e5d886010458 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:40.804227 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85166d69-7607-46af-aa87-e5d886010458 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:40.804952 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85166d69-7607-46af-aa87-e5d886010458 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:40.805409 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85166d69-7607-46af-aa87-e5d886010458 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:40.805835 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85166d69-7607-46af-aa87-e5d886010458 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:40.929353 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c4a58524-c156-42c3-90bf-038c83fa0b75 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:40.930655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4a58524-c156-42c3-90bf-038c83fa0b75 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:40.937036 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4a58524-c156-42c3-90bf-038c83fa0b75 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:40.937528 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4a58524-c156-42c3-90bf-038c83fa0b75 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:40.937962 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4a58524-c156-42c3-90bf-038c83fa0b75 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:40.938798 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4a58524-c156-42c3-90bf-038c83fa0b75 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:40.939438 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4a58524-c156-42c3-90bf-038c83fa0b75 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:40.939859 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4a58524-c156-42c3-90bf-038c83fa0b75 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:40.958051 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-85166d69-7607-46af-aa87-e5d886010458 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:40.967073 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85166d69-7607-46af-aa87-e5d886010458 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.175850 Sep 17 21:13:40.978235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 456/893] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:40 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:41.086801 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c4a58524-c156-42c3-90bf-038c83fa0b75 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:41.096343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c4a58524-c156-42c3-90bf-038c83fa0b75 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:41.098018 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c4a58524-c156-42c3-90bf-038c83fa0b75 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:41.099206 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c4a58524-c156-42c3-90bf-038c83fa0b75 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.175366 Sep 17 21:13:41.100133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 438/894] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:40 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:41.379090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a6cbdb4b-dee7-480a-8f76-5defa4577abd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:41.379790 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a6cbdb4b-dee7-480a-8f76-5defa4577abd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:41.386518 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6cbdb4b-dee7-480a-8f76-5defa4577abd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:41.390902 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6cbdb4b-dee7-480a-8f76-5defa4577abd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:41.390902 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6cbdb4b-dee7-480a-8f76-5defa4577abd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:41.390902 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6cbdb4b-dee7-480a-8f76-5defa4577abd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:41.390902 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6cbdb4b-dee7-480a-8f76-5defa4577abd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:41.391338 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6cbdb4b-dee7-480a-8f76-5defa4577abd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:41.525536 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a6cbdb4b-dee7-480a-8f76-5defa4577abd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:41.543293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a6cbdb4b-dee7-480a-8f76-5defa4577abd tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.168200 Sep 17 21:13:41.561188 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 457/895] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:41 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:41.990401 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-932e1432-9a62-422e-a34b-867c77ac117a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:41.991045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-932e1432-9a62-422e-a34b-867c77ac117a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:41.998107 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932e1432-9a62-422e-a34b-867c77ac117a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:41.998598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932e1432-9a62-422e-a34b-867c77ac117a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:41.999031 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932e1432-9a62-422e-a34b-867c77ac117a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:41.999725 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932e1432-9a62-422e-a34b-867c77ac117a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:42.000373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932e1432-9a62-422e-a34b-867c77ac117a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:42.000824 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932e1432-9a62-422e-a34b-867c77ac117a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:42.126087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad4f6f2c-0c2c-47b7-af04-a53a18825d31 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:42.126735 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ad4f6f2c-0c2c-47b7-af04-a53a18825d31 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:42.132956 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-932e1432-9a62-422e-a34b-867c77ac117a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:42.133523 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad4f6f2c-0c2c-47b7-af04-a53a18825d31 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:42.134020 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad4f6f2c-0c2c-47b7-af04-a53a18825d31 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:42.134475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad4f6f2c-0c2c-47b7-af04-a53a18825d31 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:42.135183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad4f6f2c-0c2c-47b7-af04-a53a18825d31 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:42.135637 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad4f6f2c-0c2c-47b7-af04-a53a18825d31 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:42.136062 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad4f6f2c-0c2c-47b7-af04-a53a18825d31 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:42.141191 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-932e1432-9a62-422e-a34b-867c77ac117a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.154767 Sep 17 21:13:42.141833 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 439/896] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:41 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:42.264627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ad4f6f2c-0c2c-47b7-af04-a53a18825d31 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:42.274809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ad4f6f2c-0c2c-47b7-af04-a53a18825d31 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:42.276543 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ad4f6f2c-0c2c-47b7-af04-a53a18825d31 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:42.278827 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad4f6f2c-0c2c-47b7-af04-a53a18825d31 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.156530 Sep 17 21:13:42.279487 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 458/897] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:42 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:42.567767 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-862327a9-91a6-4b67-b7d5-401be6206729 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:42.568292 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-862327a9-91a6-4b67-b7d5-401be6206729 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:42.574284 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-862327a9-91a6-4b67-b7d5-401be6206729 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:42.575297 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-862327a9-91a6-4b67-b7d5-401be6206729 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:42.575742 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-862327a9-91a6-4b67-b7d5-401be6206729 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:42.576617 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-862327a9-91a6-4b67-b7d5-401be6206729 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:42.577103 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-862327a9-91a6-4b67-b7d5-401be6206729 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:42.577543 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-862327a9-91a6-4b67-b7d5-401be6206729 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:42.750784 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-862327a9-91a6-4b67-b7d5-401be6206729 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:42.759057 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-862327a9-91a6-4b67-b7d5-401be6206729 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.195471 Sep 17 21:13:42.759842 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 440/898] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:42 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:43.163562 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bfdc3db7-3d47-49ef-b867-51d02633fa92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:43.164310 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bfdc3db7-3d47-49ef-b867-51d02633fa92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:43.177894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfdc3db7-3d47-49ef-b867-51d02633fa92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:43.178376 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfdc3db7-3d47-49ef-b867-51d02633fa92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:43.178807 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfdc3db7-3d47-49ef-b867-51d02633fa92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:43.179519 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfdc3db7-3d47-49ef-b867-51d02633fa92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:43.179956 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfdc3db7-3d47-49ef-b867-51d02633fa92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:43.180373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfdc3db7-3d47-49ef-b867-51d02633fa92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:43.305506 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae9ec33f-24c1-4562-bf3a-bf0d5f90213d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:43.306145 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ae9ec33f-24c1-4562-bf3a-bf0d5f90213d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:43.318483 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae9ec33f-24c1-4562-bf3a-bf0d5f90213d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:43.321389 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae9ec33f-24c1-4562-bf3a-bf0d5f90213d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:43.321839 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae9ec33f-24c1-4562-bf3a-bf0d5f90213d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:43.322553 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae9ec33f-24c1-4562-bf3a-bf0d5f90213d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:43.323012 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae9ec33f-24c1-4562-bf3a-bf0d5f90213d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:43.323437 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae9ec33f-24c1-4562-bf3a-bf0d5f90213d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:43.363790 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-bfdc3db7-3d47-49ef-b867-51d02633fa92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:43.371553 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bfdc3db7-3d47-49ef-b867-51d02633fa92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.211780 Sep 17 21:13:43.372996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 459/899] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:43 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:43.460758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae9ec33f-24c1-4562-bf3a-bf0d5f90213d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:43.468820 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae9ec33f-24c1-4562-bf3a-bf0d5f90213d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:43.470290 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae9ec33f-24c1-4562-bf3a-bf0d5f90213d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:43.471438 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae9ec33f-24c1-4562-bf3a-bf0d5f90213d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.169952 Sep 17 21:13:43.471986 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 441/900] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:43 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:43.783475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6de4aaa4-6b03-4f01-b7f6-ee06d252a2c5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:43.784071 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6de4aaa4-6b03-4f01-b7f6-ee06d252a2c5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:43.790178 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6de4aaa4-6b03-4f01-b7f6-ee06d252a2c5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:43.790653 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6de4aaa4-6b03-4f01-b7f6-ee06d252a2c5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:43.791085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6de4aaa4-6b03-4f01-b7f6-ee06d252a2c5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:43.791756 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6de4aaa4-6b03-4f01-b7f6-ee06d252a2c5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:43.792481 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6de4aaa4-6b03-4f01-b7f6-ee06d252a2c5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:43.792924 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6de4aaa4-6b03-4f01-b7f6-ee06d252a2c5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:43.929428 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6de4aaa4-6b03-4f01-b7f6-ee06d252a2c5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:43.950439 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6de4aaa4-6b03-4f01-b7f6-ee06d252a2c5 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.170100 Sep 17 21:13:43.956759 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 460/901] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:43 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:44.401756 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d3e016a3-308f-49e1-9425-600b4cb0a56b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:44.403969 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d3e016a3-308f-49e1-9425-600b4cb0a56b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:44.417283 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3e016a3-308f-49e1-9425-600b4cb0a56b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:44.417283 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3e016a3-308f-49e1-9425-600b4cb0a56b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:44.417283 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3e016a3-308f-49e1-9425-600b4cb0a56b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:44.417283 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3e016a3-308f-49e1-9425-600b4cb0a56b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:44.417756 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3e016a3-308f-49e1-9425-600b4cb0a56b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:44.417756 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3e016a3-308f-49e1-9425-600b4cb0a56b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:44.499846 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9318350b-77de-420e-905c-32c6718b21fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:44.500457 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9318350b-77de-420e-905c-32c6718b21fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:44.506895 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9318350b-77de-420e-905c-32c6718b21fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:44.507380 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9318350b-77de-420e-905c-32c6718b21fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:44.507813 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9318350b-77de-420e-905c-32c6718b21fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:44.508540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9318350b-77de-420e-905c-32c6718b21fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:44.509018 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9318350b-77de-420e-905c-32c6718b21fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:44.509439 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9318350b-77de-420e-905c-32c6718b21fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:44.566679 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d3e016a3-308f-49e1-9425-600b4cb0a56b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:44.574456 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d3e016a3-308f-49e1-9425-600b4cb0a56b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.178756 Sep 17 21:13:44.575600 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 442/902] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:44 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:44.647043 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9318350b-77de-420e-905c-32c6718b21fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:44.655422 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9318350b-77de-420e-905c-32c6718b21fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:44.656902 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9318350b-77de-420e-905c-32c6718b21fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:44.658066 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9318350b-77de-420e-905c-32c6718b21fe tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.162749 Sep 17 21:13:44.658625 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 461/903] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:44 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:44.974616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2b372806-3441-44f1-948e-8c0101ab110f tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:44.975218 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2b372806-3441-44f1-948e-8c0101ab110f tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:44.981540 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b372806-3441-44f1-948e-8c0101ab110f tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:44.982060 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b372806-3441-44f1-948e-8c0101ab110f tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:44.982490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b372806-3441-44f1-948e-8c0101ab110f tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:44.983180 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b372806-3441-44f1-948e-8c0101ab110f tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:44.983632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b372806-3441-44f1-948e-8c0101ab110f tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:44.984052 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b372806-3441-44f1-948e-8c0101ab110f tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:45.119178 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2b372806-3441-44f1-948e-8c0101ab110f tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:45.127691 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2b372806-3441-44f1-948e-8c0101ab110f tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.157055 Sep 17 21:13:45.128248 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 443/904] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:44 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:45.600304 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-964c91f3-4b47-44ac-845f-404987750658 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:45.602090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-964c91f3-4b47-44ac-845f-404987750658 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:45.609607 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-964c91f3-4b47-44ac-845f-404987750658 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:45.610479 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-964c91f3-4b47-44ac-845f-404987750658 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:45.610994 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-964c91f3-4b47-44ac-845f-404987750658 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:45.611828 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-964c91f3-4b47-44ac-845f-404987750658 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:45.612498 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-964c91f3-4b47-44ac-845f-404987750658 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:45.613183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-964c91f3-4b47-44ac-845f-404987750658 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:45.685982 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1feed2eb-53fd-4a5f-a5b3-788898ceacfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:45.688153 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1feed2eb-53fd-4a5f-a5b3-788898ceacfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:45.694948 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1feed2eb-53fd-4a5f-a5b3-788898ceacfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:45.695129 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1feed2eb-53fd-4a5f-a5b3-788898ceacfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:45.695562 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1feed2eb-53fd-4a5f-a5b3-788898ceacfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:45.696267 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1feed2eb-53fd-4a5f-a5b3-788898ceacfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:45.697375 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1feed2eb-53fd-4a5f-a5b3-788898ceacfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:45.697375 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1feed2eb-53fd-4a5f-a5b3-788898ceacfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:45.794377 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-964c91f3-4b47-44ac-845f-404987750658 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:45.805117 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-964c91f3-4b47-44ac-845f-404987750658 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.209214 Sep 17 21:13:45.822337 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 462/905] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:45 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:45.852800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1feed2eb-53fd-4a5f-a5b3-788898ceacfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:45.863598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1feed2eb-53fd-4a5f-a5b3-788898ceacfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:45.865370 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1feed2eb-53fd-4a5f-a5b3-788898ceacfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:45.866714 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1feed2eb-53fd-4a5f-a5b3-788898ceacfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.186656 Sep 17 21:13:45.881450 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 444/906] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:45 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:46.151359 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10aeeff2-9c8b-49fb-bcf7-8a29e0780c72 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:46.151668 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-10aeeff2-9c8b-49fb-bcf7-8a29e0780c72 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:46.159329 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10aeeff2-9c8b-49fb-bcf7-8a29e0780c72 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:46.159981 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10aeeff2-9c8b-49fb-bcf7-8a29e0780c72 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:46.160545 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10aeeff2-9c8b-49fb-bcf7-8a29e0780c72 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:46.161279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10aeeff2-9c8b-49fb-bcf7-8a29e0780c72 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:46.161739 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10aeeff2-9c8b-49fb-bcf7-8a29e0780c72 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:46.162166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10aeeff2-9c8b-49fb-bcf7-8a29e0780c72 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:46.311138 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-10aeeff2-9c8b-49fb-bcf7-8a29e0780c72 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:46.319071 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-10aeeff2-9c8b-49fb-bcf7-8a29e0780c72 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.171812 Sep 17 21:13:46.319862 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 463/907] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:46 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:46.831950 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-de7fff2e-401a-421a-8321-8efab8674995 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:46.833498 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de7fff2e-401a-421a-8321-8efab8674995 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:46.844431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de7fff2e-401a-421a-8321-8efab8674995 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:46.845043 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de7fff2e-401a-421a-8321-8efab8674995 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:46.845785 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de7fff2e-401a-421a-8321-8efab8674995 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:46.846490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de7fff2e-401a-421a-8321-8efab8674995 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:46.846941 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de7fff2e-401a-421a-8321-8efab8674995 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:46.857514 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de7fff2e-401a-421a-8321-8efab8674995 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:46.896519 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9a93896-6685-4498-8895-705963020173 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:46.897177 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9a93896-6685-4498-8895-705963020173 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:46.935815 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9a93896-6685-4498-8895-705963020173 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:46.936443 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9a93896-6685-4498-8895-705963020173 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:46.937008 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9a93896-6685-4498-8895-705963020173 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:46.937834 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9a93896-6685-4498-8895-705963020173 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:46.938709 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9a93896-6685-4498-8895-705963020173 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:46.939808 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9a93896-6685-4498-8895-705963020173 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:47.117142 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-de7fff2e-401a-421a-8321-8efab8674995 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:47.125877 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-de7fff2e-401a-421a-8321-8efab8674995 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.297597 Sep 17 21:13:47.126462 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 445/908] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:46 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:47.152924 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9a93896-6685-4498-8895-705963020173 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:47.162321 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9a93896-6685-4498-8895-705963020173 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:47.163772 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9a93896-6685-4498-8895-705963020173 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:47.164975 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9a93896-6685-4498-8895-705963020173 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.274285 Sep 17 21:13:47.165533 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 464/909] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:46 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:47.343145 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ceb972f3-a7a9-4e82-9c71-20272e706c03 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:47.343685 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ceb972f3-a7a9-4e82-9c71-20272e706c03 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:47.349605 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceb972f3-a7a9-4e82-9c71-20272e706c03 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:47.350081 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceb972f3-a7a9-4e82-9c71-20272e706c03 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:47.350613 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceb972f3-a7a9-4e82-9c71-20272e706c03 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:47.351343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceb972f3-a7a9-4e82-9c71-20272e706c03 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:47.351799 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceb972f3-a7a9-4e82-9c71-20272e706c03 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:47.352350 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceb972f3-a7a9-4e82-9c71-20272e706c03 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:47.514685 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ceb972f3-a7a9-4e82-9c71-20272e706c03 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:47.522936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ceb972f3-a7a9-4e82-9c71-20272e706c03 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.184232 Sep 17 21:13:47.523510 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 446/910] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:47 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:48.149444 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-344010fe-b405-4f89-854e-8f2441e2ac8f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:48.150063 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-344010fe-b405-4f89-854e-8f2441e2ac8f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:48.157339 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-344010fe-b405-4f89-854e-8f2441e2ac8f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:48.157826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-344010fe-b405-4f89-854e-8f2441e2ac8f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:48.158260 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-344010fe-b405-4f89-854e-8f2441e2ac8f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:48.158956 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-344010fe-b405-4f89-854e-8f2441e2ac8f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:48.159415 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-344010fe-b405-4f89-854e-8f2441e2ac8f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:48.159845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-344010fe-b405-4f89-854e-8f2441e2ac8f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:48.191234 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07c546c2-f3cd-4a86-a384-597789ca7786 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:48.191842 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07c546c2-f3cd-4a86-a384-597789ca7786 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:48.198388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07c546c2-f3cd-4a86-a384-597789ca7786 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:48.198876 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07c546c2-f3cd-4a86-a384-597789ca7786 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:48.199311 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07c546c2-f3cd-4a86-a384-597789ca7786 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:48.200219 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07c546c2-f3cd-4a86-a384-597789ca7786 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:48.200823 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07c546c2-f3cd-4a86-a384-597789ca7786 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:48.201255 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07c546c2-f3cd-4a86-a384-597789ca7786 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:48.345194 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-344010fe-b405-4f89-854e-8f2441e2ac8f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:48.353025 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-344010fe-b405-4f89-854e-8f2441e2ac8f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.207357 Sep 17 21:13:48.353589 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 465/911] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:48 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:48.375323 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-07c546c2-f3cd-4a86-a384-597789ca7786 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:48.383400 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-07c546c2-f3cd-4a86-a384-597789ca7786 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:48.384876 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-07c546c2-f3cd-4a86-a384-597789ca7786 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:48.386023 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07c546c2-f3cd-4a86-a384-597789ca7786 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.198884 Sep 17 21:13:48.386572 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 447/912] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:48 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:48.490213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aa85c307-5246-4165-9956-709e28b78ae6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:48.490631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aa85c307-5246-4165-9956-709e28b78ae6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:48.496702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa85c307-5246-4165-9956-709e28b78ae6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:48.497187 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa85c307-5246-4165-9956-709e28b78ae6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:48.497627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa85c307-5246-4165-9956-709e28b78ae6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:48.498311 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa85c307-5246-4165-9956-709e28b78ae6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:48.498756 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa85c307-5246-4165-9956-709e28b78ae6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:48.499175 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa85c307-5246-4165-9956-709e28b78ae6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:48.522239 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aa85c307-5246-4165-9956-709e28b78ae6 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8/ips" status: 200 len: 149 microversion: 2.1 time: 0.035990 Sep 17 21:13:48.522787 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 466/913] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 17 21:13:48 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:48.546083 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a9ce1825-9fd8-43bd-ae29-840243bf0175 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:48.546765 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a9ce1825-9fd8-43bd-ae29-840243bf0175 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:48.552655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9ce1825-9fd8-43bd-ae29-840243bf0175 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:48.553249 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9ce1825-9fd8-43bd-ae29-840243bf0175 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:48.553662 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9ce1825-9fd8-43bd-ae29-840243bf0175 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:48.554343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9ce1825-9fd8-43bd-ae29-840243bf0175 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:48.554792 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9ce1825-9fd8-43bd-ae29-840243bf0175 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:48.555211 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9ce1825-9fd8-43bd-ae29-840243bf0175 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:48.685222 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9ce1825-9fd8-43bd-ae29-840243bf0175 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:48.693225 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a9ce1825-9fd8-43bd-ae29-840243bf0175 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.151145 Sep 17 21:13:48.704770 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 448/914] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:48 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:49.377289 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f8395385-d41c-4618-a7fa-dee119b0005b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:49.377837 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f8395385-d41c-4618-a7fa-dee119b0005b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:49.384184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8395385-d41c-4618-a7fa-dee119b0005b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:49.384667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8395385-d41c-4618-a7fa-dee119b0005b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:49.385134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8395385-d41c-4618-a7fa-dee119b0005b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:49.385827 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8395385-d41c-4618-a7fa-dee119b0005b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:49.386279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8395385-d41c-4618-a7fa-dee119b0005b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:49.386732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8395385-d41c-4618-a7fa-dee119b0005b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:49.412000 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0a3440b-484d-440c-a43a-6f7c55b0289b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:49.412718 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0a3440b-484d-440c-a43a-6f7c55b0289b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:49.419932 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0a3440b-484d-440c-a43a-6f7c55b0289b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:49.420489 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0a3440b-484d-440c-a43a-6f7c55b0289b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:49.421013 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0a3440b-484d-440c-a43a-6f7c55b0289b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:49.421775 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0a3440b-484d-440c-a43a-6f7c55b0289b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:49.422291 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0a3440b-484d-440c-a43a-6f7c55b0289b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:49.422849 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0a3440b-484d-440c-a43a-6f7c55b0289b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:49.438776 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:49.567457 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f8395385-d41c-4618-a7fa-dee119b0005b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:49.576265 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f8395385-d41c-4618-a7fa-dee119b0005b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.203402 Sep 17 21:13:49.576866 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 467/915] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:49 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:49.593018 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0a3440b-484d-440c-a43a-6f7c55b0289b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:49.601179 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0a3440b-484d-440c-a43a-6f7c55b0289b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:49.602639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0a3440b-484d-440c-a43a-6f7c55b0289b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:49.603791 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0a3440b-484d-440c-a43a-6f7c55b0289b tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.195703 Sep 17 21:13:49.604339 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 449/916] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:49 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:49.721871 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53006812-aae3-40d0-a353-9b9ebf19208e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:49.722474 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-53006812-aae3-40d0-a353-9b9ebf19208e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:49.728239 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53006812-aae3-40d0-a353-9b9ebf19208e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:49.728805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53006812-aae3-40d0-a353-9b9ebf19208e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:49.729238 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53006812-aae3-40d0-a353-9b9ebf19208e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:49.729922 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53006812-aae3-40d0-a353-9b9ebf19208e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:49.730372 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53006812-aae3-40d0-a353-9b9ebf19208e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:49.731205 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53006812-aae3-40d0-a353-9b9ebf19208e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:49.859472 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d9c40fb2-b50a-494e-80be-5d5c88a9f124 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "352e4c08-beff-4736-aaf3-75850ef190f4"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:49.861948 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d9c40fb2-b50a-494e-80be-5d5c88a9f124 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:49.864213 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-53006812-aae3-40d0-a353-9b9ebf19208e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:49.866513 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:49.867938 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9c40fb2-b50a-494e-80be-5d5c88a9f124 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:49.868492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9c40fb2-b50a-494e-80be-5d5c88a9f124 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:49.869003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9c40fb2-b50a-494e-80be-5d5c88a9f124 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:49.869654 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9c40fb2-b50a-494e-80be-5d5c88a9f124 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:49.870108 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9c40fb2-b50a-494e-80be-5d5c88a9f124 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:49.870534 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9c40fb2-b50a-494e-80be-5d5c88a9f124 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:49.873793 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53006812-aae3-40d0-a353-9b9ebf19208e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.155773 Sep 17 21:13:49.874355 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 468/917] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:49 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:50.599050 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-46b76183-174c-448f-93e9-8551dfe346cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:50.599697 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-46b76183-174c-448f-93e9-8551dfe346cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:50.606075 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46b76183-174c-448f-93e9-8551dfe346cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:50.606561 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46b76183-174c-448f-93e9-8551dfe346cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:50.606992 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46b76183-174c-448f-93e9-8551dfe346cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:50.607671 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46b76183-174c-448f-93e9-8551dfe346cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:50.608120 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46b76183-174c-448f-93e9-8551dfe346cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:50.608540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46b76183-174c-448f-93e9-8551dfe346cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:50.893936 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-46b76183-174c-448f-93e9-8551dfe346cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:50.901558 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-46b76183-174c-448f-93e9-8551dfe346cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.306653 Sep 17 21:13:50.902120 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 469/918] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:50 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:50.907594 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-36020815-189c-4cf5-ae03-38209e9cbd3d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:50.908194 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-36020815-189c-4cf5-ae03-38209e9cbd3d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:50.913657 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36020815-189c-4cf5-ae03-38209e9cbd3d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:50.914140 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36020815-189c-4cf5-ae03-38209e9cbd3d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:50.914575 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36020815-189c-4cf5-ae03-38209e9cbd3d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:50.915268 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36020815-189c-4cf5-ae03-38209e9cbd3d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:50.915721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36020815-189c-4cf5-ae03-38209e9cbd3d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:50.916143 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36020815-189c-4cf5-ae03-38209e9cbd3d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:51.040653 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-36020815-189c-4cf5-ae03-38209e9cbd3d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:51.048718 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-36020815-189c-4cf5-ae03-38209e9cbd3d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:51.050144 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-36020815-189c-4cf5-ae03-38209e9cbd3d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:51.051288 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-36020815-189c-4cf5-ae03-38209e9cbd3d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.147614 Sep 17 21:13:51.051832 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 470/919] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:50 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:51.056105 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cfac5f52-f768-4e5f-a438-a512a10d59c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:51.056720 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cfac5f52-f768-4e5f-a438-a512a10d59c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:51.063010 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfac5f52-f768-4e5f-a438-a512a10d59c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:51.063487 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfac5f52-f768-4e5f-a438-a512a10d59c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:51.063936 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfac5f52-f768-4e5f-a438-a512a10d59c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:51.064609 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfac5f52-f768-4e5f-a438-a512a10d59c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:51.065090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfac5f52-f768-4e5f-a438-a512a10d59c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:51.065778 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfac5f52-f768-4e5f-a438-a512a10d59c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:51.194290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cfac5f52-f768-4e5f-a438-a512a10d59c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:51.204520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cfac5f52-f768-4e5f-a438-a512a10d59c2 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.151451 Sep 17 21:13:51.205483 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 471/920] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:51 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:51.925137 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a6f1d39-4568-431d-a803-99e760340dcc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:51.925781 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a6f1d39-4568-431d-a803-99e760340dcc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:51.931985 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6f1d39-4568-431d-a803-99e760340dcc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:51.932469 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6f1d39-4568-431d-a803-99e760340dcc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:51.932942 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6f1d39-4568-431d-a803-99e760340dcc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:51.933632 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6f1d39-4568-431d-a803-99e760340dcc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:51.934157 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6f1d39-4568-431d-a803-99e760340dcc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:51.934633 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6f1d39-4568-431d-a803-99e760340dcc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:52.061882 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a6f1d39-4568-431d-a803-99e760340dcc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:52.069907 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a6f1d39-4568-431d-a803-99e760340dcc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.148558 Sep 17 21:13:52.070460 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 472/921] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:51 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:52.076655 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-abe1b78d-876e-4397-9f69-44ed5f944226 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:52.077281 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-abe1b78d-876e-4397-9f69-44ed5f944226 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:52.082844 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abe1b78d-876e-4397-9f69-44ed5f944226 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:52.083330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abe1b78d-876e-4397-9f69-44ed5f944226 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:52.083770 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abe1b78d-876e-4397-9f69-44ed5f944226 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:52.084497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abe1b78d-876e-4397-9f69-44ed5f944226 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:52.084994 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abe1b78d-876e-4397-9f69-44ed5f944226 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:52.085408 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abe1b78d-876e-4397-9f69-44ed5f944226 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:52.210568 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-abe1b78d-876e-4397-9f69-44ed5f944226 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:52.219042 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-abe1b78d-876e-4397-9f69-44ed5f944226 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:52.220458 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-abe1b78d-876e-4397-9f69-44ed5f944226 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:52.222171 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-abe1b78d-876e-4397-9f69-44ed5f944226 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.148418 Sep 17 21:13:52.222171 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 473/922] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:52 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:52.227399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e31ad8b-44a1-429b-8380-2779e12072f8 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:52.227995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3e31ad8b-44a1-429b-8380-2779e12072f8 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:52.234702 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e31ad8b-44a1-429b-8380-2779e12072f8 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:52.235195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e31ad8b-44a1-429b-8380-2779e12072f8 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:52.235623 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e31ad8b-44a1-429b-8380-2779e12072f8 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:52.236316 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e31ad8b-44a1-429b-8380-2779e12072f8 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:52.236861 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e31ad8b-44a1-429b-8380-2779e12072f8 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:52.237225 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e31ad8b-44a1-429b-8380-2779e12072f8 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:52.369063 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3e31ad8b-44a1-429b-8380-2779e12072f8 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:52.377201 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3e31ad8b-44a1-429b-8380-2779e12072f8 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.153077 Sep 17 21:13:52.377766 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 474/923] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:52 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:53.093228 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35e1d86f-fad7-446d-ae33-ce9526a19eb9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:53.094010 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-35e1d86f-fad7-446d-ae33-ce9526a19eb9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:53.100116 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35e1d86f-fad7-446d-ae33-ce9526a19eb9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:53.100594 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35e1d86f-fad7-446d-ae33-ce9526a19eb9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:53.101173 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35e1d86f-fad7-446d-ae33-ce9526a19eb9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:53.101867 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35e1d86f-fad7-446d-ae33-ce9526a19eb9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:53.102316 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35e1d86f-fad7-446d-ae33-ce9526a19eb9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:53.102735 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35e1d86f-fad7-446d-ae33-ce9526a19eb9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:53.234049 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-35e1d86f-fad7-446d-ae33-ce9526a19eb9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:53.241907 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35e1d86f-fad7-446d-ae33-ce9526a19eb9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.153181 Sep 17 21:13:53.242852 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 475/924] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:53 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:53.247366 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de242bc3-3008-40ee-9d33-93caf0d06cbd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:53.247956 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-de242bc3-3008-40ee-9d33-93caf0d06cbd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:53.254241 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de242bc3-3008-40ee-9d33-93caf0d06cbd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:53.254895 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de242bc3-3008-40ee-9d33-93caf0d06cbd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:53.255451 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de242bc3-3008-40ee-9d33-93caf0d06cbd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:53.256313 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de242bc3-3008-40ee-9d33-93caf0d06cbd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:53.256934 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de242bc3-3008-40ee-9d33-93caf0d06cbd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:53.257518 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de242bc3-3008-40ee-9d33-93caf0d06cbd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:53.387243 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-de242bc3-3008-40ee-9d33-93caf0d06cbd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:53.396302 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-de242bc3-3008-40ee-9d33-93caf0d06cbd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:53.397754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-de242bc3-3008-40ee-9d33-93caf0d06cbd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:53.398895 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-de242bc3-3008-40ee-9d33-93caf0d06cbd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.155125 Sep 17 21:13:53.399431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 476/925] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:53 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:53.403821 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41ee6191-0939-4a3d-9e2d-dfc7cbdf7d3e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:53.404419 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41ee6191-0939-4a3d-9e2d-dfc7cbdf7d3e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:53.406109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:53.411276 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41ee6191-0939-4a3d-9e2d-dfc7cbdf7d3e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:53.411748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41ee6191-0939-4a3d-9e2d-dfc7cbdf7d3e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:53.412172 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41ee6191-0939-4a3d-9e2d-dfc7cbdf7d3e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:53.412885 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41ee6191-0939-4a3d-9e2d-dfc7cbdf7d3e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:53.413330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41ee6191-0939-4a3d-9e2d-dfc7cbdf7d3e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:53.413744 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41ee6191-0939-4a3d-9e2d-dfc7cbdf7d3e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:53.539690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-41ee6191-0939-4a3d-9e2d-dfc7cbdf7d3e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:53.547384 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41ee6191-0939-4a3d-9e2d-dfc7cbdf7d3e tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.147027 Sep 17 21:13:53.547937 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 477/926] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:53 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:54.213644 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d9c40fb2-b50a-494e-80be-5d5c88a9f124 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "POST /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.357960 Sep 17 21:13:54.214822 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 450/927] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:13:49 2022] POST /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8/os-volume_attachments => generated 194 bytes in 4360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:13:54.267188 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6617c0d4-a0a3-4cd2-971a-adad769fa1ce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:54.268100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6617c0d4-a0a3-4cd2-971a-adad769fa1ce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:54.282981 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6617c0d4-a0a3-4cd2-971a-adad769fa1ce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:54.282981 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6617c0d4-a0a3-4cd2-971a-adad769fa1ce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:54.282981 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6617c0d4-a0a3-4cd2-971a-adad769fa1ce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:54.282981 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6617c0d4-a0a3-4cd2-971a-adad769fa1ce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:54.283314 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6617c0d4-a0a3-4cd2-971a-adad769fa1ce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:54.283314 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6617c0d4-a0a3-4cd2-971a-adad769fa1ce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:54.411556 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6617c0d4-a0a3-4cd2-971a-adad769fa1ce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:54.419412 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6617c0d4-a0a3-4cd2-971a-adad769fa1ce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.157343 Sep 17 21:13:54.420104 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 478/928] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:54 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:54.424623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3245bbb0-0ec2-4e05-b0ca-be746b6075d3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:54.425373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3245bbb0-0ec2-4e05-b0ca-be746b6075d3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:54.431518 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3245bbb0-0ec2-4e05-b0ca-be746b6075d3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:54.431990 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3245bbb0-0ec2-4e05-b0ca-be746b6075d3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:54.432422 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3245bbb0-0ec2-4e05-b0ca-be746b6075d3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:54.433135 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3245bbb0-0ec2-4e05-b0ca-be746b6075d3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:54.433594 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3245bbb0-0ec2-4e05-b0ca-be746b6075d3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:54.434017 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3245bbb0-0ec2-4e05-b0ca-be746b6075d3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:54.571400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4aad4093-96ce-48bb-a589-5522ec90a195 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:54.572014 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4aad4093-96ce-48bb-a589-5522ec90a195 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:54.578956 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4aad4093-96ce-48bb-a589-5522ec90a195 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:54.579546 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4aad4093-96ce-48bb-a589-5522ec90a195 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:54.579987 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4aad4093-96ce-48bb-a589-5522ec90a195 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:54.580738 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4aad4093-96ce-48bb-a589-5522ec90a195 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:54.581200 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4aad4093-96ce-48bb-a589-5522ec90a195 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:54.581622 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4aad4093-96ce-48bb-a589-5522ec90a195 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:54.874999 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3245bbb0-0ec2-4e05-b0ca-be746b6075d3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:54.883501 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3245bbb0-0ec2-4e05-b0ca-be746b6075d3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:54.885004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3245bbb0-0ec2-4e05-b0ca-be746b6075d3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:54.887270 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3245bbb0-0ec2-4e05-b0ca-be746b6075d3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.467516 Sep 17 21:13:54.887828 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 451/929] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:54 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:54.894655 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4aad4093-96ce-48bb-a589-5522ec90a195 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:54.902632 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4aad4093-96ce-48bb-a589-5522ec90a195 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.335334 Sep 17 21:13:54.903278 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 479/930] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:54 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:55.442690 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b7659081-028d-4150-a521-8b8c39f0e19c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:55.443544 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b7659081-028d-4150-a521-8b8c39f0e19c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:55.450161 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7659081-028d-4150-a521-8b8c39f0e19c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:55.450800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7659081-028d-4150-a521-8b8c39f0e19c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:55.451452 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7659081-028d-4150-a521-8b8c39f0e19c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:55.452152 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7659081-028d-4150-a521-8b8c39f0e19c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:55.452616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7659081-028d-4150-a521-8b8c39f0e19c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:55.453067 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7659081-028d-4150-a521-8b8c39f0e19c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:55.583475 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b7659081-028d-4150-a521-8b8c39f0e19c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:55.591591 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b7659081-028d-4150-a521-8b8c39f0e19c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.152835 Sep 17 21:13:55.592449 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 452/931] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:55 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:55.912764 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5591ced-e158-4836-a45f-4a1818dcf85c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:55.913371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c5591ced-e158-4836-a45f-4a1818dcf85c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:55.919987 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5591ced-e158-4836-a45f-4a1818dcf85c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:55.920470 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5591ced-e158-4836-a45f-4a1818dcf85c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:55.920933 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5591ced-e158-4836-a45f-4a1818dcf85c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:55.921630 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5591ced-e158-4836-a45f-4a1818dcf85c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:55.922082 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5591ced-e158-4836-a45f-4a1818dcf85c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:55.922531 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5591ced-e158-4836-a45f-4a1818dcf85c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:55.928371 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-54292be0-05df-494e-a567-c881e7893ac9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:55.928999 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-54292be0-05df-494e-a567-c881e7893ac9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:55.935104 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54292be0-05df-494e-a567-c881e7893ac9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:55.935591 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54292be0-05df-494e-a567-c881e7893ac9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:55.936024 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54292be0-05df-494e-a567-c881e7893ac9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:55.936737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54292be0-05df-494e-a567-c881e7893ac9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:55.937189 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54292be0-05df-494e-a567-c881e7893ac9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:55.937609 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54292be0-05df-494e-a567-c881e7893ac9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:56.126973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c5591ced-e158-4836-a45f-4a1818dcf85c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:56.131472 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-54292be0-05df-494e-a567-c881e7893ac9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:56.135522 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c5591ced-e158-4836-a45f-4a1818dcf85c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:56.136974 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c5591ced-e158-4836-a45f-4a1818dcf85c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:56.138615 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c5591ced-e158-4836-a45f-4a1818dcf85c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.229420 Sep 17 21:13:56.139164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 480/932] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:55 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:13:56.139900 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-54292be0-05df-494e-a567-c881e7893ac9 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.215239 Sep 17 21:13:56.140453 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 453/933] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:55 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:56.614432 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b059bba5-9712-4aa2-811c-ade0448506f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:56.614962 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b059bba5-9712-4aa2-811c-ade0448506f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:56.620829 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b059bba5-9712-4aa2-811c-ade0448506f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:56.621321 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b059bba5-9712-4aa2-811c-ade0448506f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:56.621762 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b059bba5-9712-4aa2-811c-ade0448506f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:56.623055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b059bba5-9712-4aa2-811c-ade0448506f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:56.623516 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b059bba5-9712-4aa2-811c-ade0448506f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:56.623947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b059bba5-9712-4aa2-811c-ade0448506f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:56.756185 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b059bba5-9712-4aa2-811c-ade0448506f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:56.764580 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b059bba5-9712-4aa2-811c-ade0448506f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.154131 Sep 17 21:13:56.765181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 481/934] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:56 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:57.163979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7a95e00-d2c0-4472-a5ad-fa3975509a4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:57.165241 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f7a95e00-d2c0-4472-a5ad-fa3975509a4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:57.168616 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e83974f1-950a-43d0-b595-225bf6a930f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:57.173658 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:57.174718 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e83974f1-950a-43d0-b595-225bf6a930f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:57.175253 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7a95e00-d2c0-4472-a5ad-fa3975509a4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.175877 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7a95e00-d2c0-4472-a5ad-fa3975509a4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.176534 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7a95e00-d2c0-4472-a5ad-fa3975509a4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.177399 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7a95e00-d2c0-4472-a5ad-fa3975509a4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.177720 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7a95e00-d2c0-4472-a5ad-fa3975509a4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.178143 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7a95e00-d2c0-4472-a5ad-fa3975509a4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.203465 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e83974f1-950a-43d0-b595-225bf6a930f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.204193 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e83974f1-950a-43d0-b595-225bf6a930f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.204634 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e83974f1-950a-43d0-b595-225bf6a930f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.205390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e83974f1-950a-43d0-b595-225bf6a930f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.205848 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e83974f1-950a-43d0-b595-225bf6a930f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.206270 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e83974f1-950a-43d0-b595-225bf6a930f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.501891 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e83974f1-950a-43d0-b595-225bf6a930f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:57.511764 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e83974f1-950a-43d0-b595-225bf6a930f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:57.514266 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e83974f1-950a-43d0-b595-225bf6a930f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:57.516494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e83974f1-950a-43d0-b595-225bf6a930f2 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.355167 Sep 17 21:13:57.518088 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 482/935] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:57 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:57.550655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7a95e00-d2c0-4472-a5ad-fa3975509a4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:57.567588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7a95e00-d2c0-4472-a5ad-fa3975509a4b tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1567 microversion: 2.1 time: 0.407975 Sep 17 21:13:57.585505 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 454/936] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:57 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1567 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:57.699547 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-119f4516-4bf7-4051-b508-51e698f728fe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:57.704233 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-119f4516-4bf7-4051-b508-51e698f728fe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:57.711785 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-119f4516-4bf7-4051-b508-51e698f728fe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.712401 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-119f4516-4bf7-4051-b508-51e698f728fe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.712957 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-119f4516-4bf7-4051-b508-51e698f728fe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.713728 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-119f4516-4bf7-4051-b508-51e698f728fe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.714332 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-119f4516-4bf7-4051-b508-51e698f728fe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.714820 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-119f4516-4bf7-4051-b508-51e698f728fe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.757239 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-119f4516-4bf7-4051-b508-51e698f728fe tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.063333 Sep 17 21:13:57.757921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 483/937] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:13:57 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:57.786350 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33977211-bccc-4cb5-90c6-0420cada970c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:57.786904 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-33977211-bccc-4cb5-90c6-0420cada970c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:57.794954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33977211-bccc-4cb5-90c6-0420cada970c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.795501 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33977211-bccc-4cb5-90c6-0420cada970c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.795930 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33977211-bccc-4cb5-90c6-0420cada970c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.796947 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33977211-bccc-4cb5-90c6-0420cada970c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.797420 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8b5ddcdb-34de-47b3-9839-bd2e78e79213 req-20baf8e4-7470-4fab-8077-afe1e1b85ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3209ceff-722f-437e-9ece-3f9542c1daa7", "name": "network-vif-deleted", "tag": "9ec72a7a-4fab-4ddb-9a94-b4581d132104"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:57.797610 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33977211-bccc-4cb5-90c6-0420cada970c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.798039 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33977211-bccc-4cb5-90c6-0420cada970c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.809469 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8b5ddcdb-34de-47b3-9839-bd2e78e79213 req-20baf8e4-7470-4fab-8077-afe1e1b85ebc service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.810643 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8b5ddcdb-34de-47b3-9839-bd2e78e79213 req-20baf8e4-7470-4fab-8077-afe1e1b85ebc service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.811112 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8b5ddcdb-34de-47b3-9839-bd2e78e79213 req-20baf8e4-7470-4fab-8077-afe1e1b85ebc service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.827083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8b5ddcdb-34de-47b3-9839-bd2e78e79213 req-20baf8e4-7470-4fab-8077-afe1e1b85ebc service nova] Creating event network-vif-deleted:9ec72a7a-4fab-4ddb-9a94-b4581d132104 for instance 3209ceff-722f-437e-9ece-3f9542c1daa7 on hv-cinder-82651 Sep 17 21:13:57.833401 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8b5ddcdb-34de-47b3-9839-bd2e78e79213 req-20baf8e4-7470-4fab-8077-afe1e1b85ebc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040570 Sep 17 21:13:57.834316 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 484/938] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:13:57.900198 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21a508c6-ff49-4637-a49f-d50dd9d6c51f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:57.900810 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21a508c6-ff49-4637-a49f-d50dd9d6c51f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:57.908346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21a508c6-ff49-4637-a49f-d50dd9d6c51f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.908880 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21a508c6-ff49-4637-a49f-d50dd9d6c51f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.909383 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21a508c6-ff49-4637-a49f-d50dd9d6c51f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.910152 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21a508c6-ff49-4637-a49f-d50dd9d6c51f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.910789 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21a508c6-ff49-4637-a49f-d50dd9d6c51f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.912290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21a508c6-ff49-4637-a49f-d50dd9d6c51f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.952555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21a508c6-ff49-4637-a49f-d50dd9d6c51f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments/5ca8436e-02e3-405f-8201-cafd4af6791d" status: 200 len: 194 microversion: 2.1 time: 0.056488 Sep 17 21:13:57.954285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 485/939] 10.222.0.16 () {58 vars in 1413 bytes} [Sat Sep 17 21:13:57 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments/5ca8436e-02e3-405f-8201-cafd4af6791d => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:13:57.957911 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-33977211-bccc-4cb5-90c6-0420cada970c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:57.966519 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3129ac1a-e445-435c-ae88-250f9ca08767 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:57.966766 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3129ac1a-e445-435c-ae88-250f9ca08767 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:57.967279 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33977211-bccc-4cb5-90c6-0420cada970c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.184706 Sep 17 21:13:57.968330 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 455/940] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:57 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:57.977405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3129ac1a-e445-435c-ae88-250f9ca08767 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.977405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3129ac1a-e445-435c-ae88-250f9ca08767 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.977405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3129ac1a-e445-435c-ae88-250f9ca08767 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.977405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3129ac1a-e445-435c-ae88-250f9ca08767 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.977804 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3129ac1a-e445-435c-ae88-250f9ca08767 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.977804 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3129ac1a-e445-435c-ae88-250f9ca08767 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.979515 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:58.085103 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-3129ac1a-e445-435c-ae88-250f9ca08767 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lazy-loading 'services' on Instance uuid e2de9d30-c24d-41d2-bbdf-79429561d8d6 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:13:58.191311 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3129ac1a-e445-435c-ae88-250f9ca08767 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments/5ca8436e-02e3-405f-8201-cafd4af6791d" status: 202 len: 0 microversion: 2.1 time: 0.230102 Sep 17 21:13:58.193837 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 486/941] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 17 21:13:57 2022] DELETE /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments/5ca8436e-02e3-405f-8201-cafd4af6791d => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:13:58.215564 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5c2d11cd-afc1-458a-8e37-de1b8f4b876e req-132177e8-5637-4947-b5c6-91e3e81f4fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c20c116-f378-4a7e-812b-45a6824e98ad", "name": "network-vif-plugged", "status": "completed", "tag": "4c335199-6467-42cd-bd0e-cd87c9b1dac8"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:58.265010 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5c2d11cd-afc1-458a-8e37-de1b8f4b876e req-132177e8-5637-4947-b5c6-91e3e81f4fc3 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:58.265508 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5c2d11cd-afc1-458a-8e37-de1b8f4b876e req-132177e8-5637-4947-b5c6-91e3e81f4fc3 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:58.265945 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5c2d11cd-afc1-458a-8e37-de1b8f4b876e req-132177e8-5637-4947-b5c6-91e3e81f4fc3 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:58.286552 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5c2d11cd-afc1-458a-8e37-de1b8f4b876e req-132177e8-5637-4947-b5c6-91e3e81f4fc3 service nova] Creating event network-vif-plugged:4c335199-6467-42cd-bd0e-cd87c9b1dac8 for instance 0c20c116-f378-4a7e-812b-45a6824e98ad on hv-cinder-82651 Sep 17 21:13:58.296446 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5c2d11cd-afc1-458a-8e37-de1b8f4b876e req-132177e8-5637-4947-b5c6-91e3e81f4fc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088229 Sep 17 21:13:58.298339 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 456/942] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:58.549680 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d72c354-7384-4ef9-a4b5-8f1632a0901d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:58.550371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4d72c354-7384-4ef9-a4b5-8f1632a0901d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:58.557230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d72c354-7384-4ef9-a4b5-8f1632a0901d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:58.557706 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d72c354-7384-4ef9-a4b5-8f1632a0901d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:58.558330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d72c354-7384-4ef9-a4b5-8f1632a0901d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:58.559028 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d72c354-7384-4ef9-a4b5-8f1632a0901d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:58.559478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d72c354-7384-4ef9-a4b5-8f1632a0901d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:58.560462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d72c354-7384-4ef9-a4b5-8f1632a0901d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:58.596522 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:58.597375 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:58.604458 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:58.604973 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:58.605588 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:58.606366 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:58.607608 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:58.608034 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:58.643247 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:58.643993 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:58.644600 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:58.645440 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lazy-loading 'fault' on Instance uuid 3209ceff-722f-437e-9ece-3f9542c1daa7 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:13:58.698536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c829f155714140bb87a78429d4e50af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c930f8134548e393831a0ef4034ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:58.707304 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-611364e0-0cf7-455f-9379-0213e01a0ba0 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 200 len: 1224 microversion: 2.1 time: 0.114923 Sep 17 21:13:58.708463 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 457/943] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:58 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:58.726707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4d72c354-7384-4ef9-a4b5-8f1632a0901d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:58.734836 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4d72c354-7384-4ef9-a4b5-8f1632a0901d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:58.736293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4d72c354-7384-4ef9-a4b5-8f1632a0901d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:58.737477 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4d72c354-7384-4ef9-a4b5-8f1632a0901d tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.192138 Sep 17 21:13:58.738017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 487/944] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:58 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:58.990246 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21f954ad-8683-45f2-9b34-6f985577166f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:58.990991 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-21f954ad-8683-45f2-9b34-6f985577166f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:58.996906 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21f954ad-8683-45f2-9b34-6f985577166f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:58.998063 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21f954ad-8683-45f2-9b34-6f985577166f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:58.998501 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21f954ad-8683-45f2-9b34-6f985577166f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:58.999190 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21f954ad-8683-45f2-9b34-6f985577166f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:58.999644 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21f954ad-8683-45f2-9b34-6f985577166f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:59.000065 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21f954ad-8683-45f2-9b34-6f985577166f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:59.136391 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-21f954ad-8683-45f2-9b34-6f985577166f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:59.145091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-21f954ad-8683-45f2-9b34-6f985577166f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.158529 Sep 17 21:13:59.145662 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 458/945] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:58 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:59.731017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2d2f25b-bfd9-443d-a0d9-346a867b0837 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:59.731668 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e2d2f25b-bfd9-443d-a0d9-346a867b0837 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] [instance: 3209ceff-722f-437e-9ece-3f9542c1daa7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:59.738121 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d2f25b-bfd9-443d-a0d9-346a867b0837 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:59.738598 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d2f25b-bfd9-443d-a0d9-346a867b0837 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:59.739030 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d2f25b-bfd9-443d-a0d9-346a867b0837 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:59.739712 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d2f25b-bfd9-443d-a0d9-346a867b0837 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:59.740163 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d2f25b-bfd9-443d-a0d9-346a867b0837 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:59.740577 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d2f25b-bfd9-443d-a0d9-346a867b0837 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:59.753764 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e2d2f25b-bfd9-443d-a0d9-346a867b0837 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] HTTP exception thrown: Instance 3209ceff-722f-437e-9ece-3f9542c1daa7 could not be found. Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2d2f25b-bfd9-443d-a0d9-346a867b0837 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Request method failure captured: Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 HTTP/1.1 Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjcY0vmaw1jSd9shKu73mDLwAtphVpq1qyeVowZcK-9RHLom7cJyiY7wwgW9cBJ-Uu29qET537OSjcRF27i8dInG-Hi1FTgaERPB-7__Zvj6fds7dSIneaIRYJPt4DndhV9zWXkQhxDCF-OD70dpzsXoVKrdWDP_k9IZIEjMpLR6MvQ Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: 36c930f8134548e393831a0ef4034ea9 Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-TestShelveInstance-733351116 Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:13:59.755418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:13:59.757055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/36c930f8134548e393831a0ef4034ea9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36c930f8134548e393831a0ef4034ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36c930f8134548e393831a0ef4034ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_36c930f8134548e393831a0ef4034ea9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:13:59.757055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-TestShelveInstance-733351116 Sep 17 21:13:59.757055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 36c930f8134548e393831a0ef4034ea9 Sep 17 21:13:59.757055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestShelveInstance-733351116 Sep 17 21:13:59.757055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-TestShelveInstance-733351116-project Sep 17 21:13:59.757055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:13:59.757055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:13:59.757055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: c829f155714140bb87a78429d4e50af3 Sep 17 21:13:59.757055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-TestShelveInstance-733351116-project Sep 17 21:13:59.757055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:13:59.757055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 3209ceff-722f-437e-9ece-3f9542c1daa7 could not be found. Sep 17 21:13:59.757055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '3209ceff-722f-437e-9ece-3f9542c1daa7'} Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3209ceff-722f-437e-9ece-3f9542c1daa7 could not be found. Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:59.758019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3209ceff-722f-437e-9ece-3f9542c1daa7 could not be found. Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3209ceff-722f-437e-9ece-3f9542c1daa7 could not be found. Sep 17 21:13:59.759621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:13:59.760878 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2d2f25b-bfd9-443d-a0d9-346a867b0837 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Returning 404 to user: Instance 3209ceff-722f-437e-9ece-3f9542c1daa7 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:59.760878 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2d2f25b-bfd9-443d-a0d9-346a867b0837 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7" status: 404 len: 111 microversion: 2.1 time: 0.029561 Sep 17 21:13:59.760878 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 488/946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:59 2022] GET /compute/v2.1/servers/3209ceff-722f-437e-9ece-3f9542c1daa7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:59.766744 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0e0a1ae5-cc03-4534-bc92-87033e05b836 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:59.767381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0e0a1ae5-cc03-4534-bc92-87033e05b836 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:59.773672 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e0a1ae5-cc03-4534-bc92-87033e05b836 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:59.774153 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e0a1ae5-cc03-4534-bc92-87033e05b836 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:59.774590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e0a1ae5-cc03-4534-bc92-87033e05b836 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:59.775307 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e0a1ae5-cc03-4534-bc92-87033e05b836 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:59.775761 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e0a1ae5-cc03-4534-bc92-87033e05b836 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:59.776177 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e0a1ae5-cc03-4534-bc92-87033e05b836 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:59.960556 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0e0a1ae5-cc03-4534-bc92-87033e05b836 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:59.972095 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0e0a1ae5-cc03-4534-bc92-87033e05b836 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:59.973613 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0e0a1ae5-cc03-4534-bc92-87033e05b836 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:59.974992 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0e0a1ae5-cc03-4534-bc92-87033e05b836 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.212591 Sep 17 21:13:59.975710 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 459/947] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:59 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:00.002800 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b9e1b092-d08a-4f8f-ac4f-927a78ac4194 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] Calling method '.version_select at 0x7f9ba73c6790>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:00.041251 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b9e1b092-d08a-4f8f-ac4f-927a78ac4194 tempest-TestShelveInstance-733351116 tempest-TestShelveInstance-733351116-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-446168923" status: 202 len: 0 microversion: 2.1 time: 0.042658 Sep 17 21:14:00.042539 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 489/948] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 17 21:13:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-446168923 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:14:00.167228 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-85206788-7acc-4644-a039-3d006213943e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:00.168117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-85206788-7acc-4644-a039-3d006213943e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:00.174269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85206788-7acc-4644-a039-3d006213943e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:00.174826 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85206788-7acc-4644-a039-3d006213943e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:00.175339 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85206788-7acc-4644-a039-3d006213943e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:00.176099 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85206788-7acc-4644-a039-3d006213943e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:00.176623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85206788-7acc-4644-a039-3d006213943e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:00.177138 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85206788-7acc-4644-a039-3d006213943e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:00.314022 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-05342860-32e0-4331-8efd-e618fc14ba18 req-8848c4ba-be46-4206-905f-8397d7f0a935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a67b77-200a-44df-918e-757ee2cae914", "name": "network-vif-plugged", "status": "completed", "tag": "26d391cd-62d3-4e74-b7fe-db22e47cae57"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:00.324523 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-05342860-32e0-4331-8efd-e618fc14ba18 req-8848c4ba-be46-4206-905f-8397d7f0a935 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:00.325195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-05342860-32e0-4331-8efd-e618fc14ba18 req-8848c4ba-be46-4206-905f-8397d7f0a935 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:00.326271 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-05342860-32e0-4331-8efd-e618fc14ba18 req-8848c4ba-be46-4206-905f-8397d7f0a935 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:00.336582 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-05342860-32e0-4331-8efd-e618fc14ba18 req-8848c4ba-be46-4206-905f-8397d7f0a935 service nova] Creating event network-vif-plugged:26d391cd-62d3-4e74-b7fe-db22e47cae57 for instance 60a67b77-200a-44df-918e-757ee2cae914 on hv-cinder-82651 Sep 17 21:14:00.341407 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-05342860-32e0-4331-8efd-e618fc14ba18 req-8848c4ba-be46-4206-905f-8397d7f0a935 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031687 Sep 17 21:14:00.341969 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 490/949] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:14:00.387878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-85206788-7acc-4644-a039-3d006213943e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:00.395878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-85206788-7acc-4644-a039-3d006213943e tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1265 microversion: 2.1 time: 0.232405 Sep 17 21:14:00.396638 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 460/950] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:00 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:01.003805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6ccfcae7-d719-4030-a460-835f42a04256 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:01.004499 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ccfcae7-d719-4030-a460-835f42a04256 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:01.010527 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ccfcae7-d719-4030-a460-835f42a04256 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:01.011014 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ccfcae7-d719-4030-a460-835f42a04256 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:01.011453 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ccfcae7-d719-4030-a460-835f42a04256 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:01.012151 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ccfcae7-d719-4030-a460-835f42a04256 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:01.012604 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ccfcae7-d719-4030-a460-835f42a04256 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:01.013616 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ccfcae7-d719-4030-a460-835f42a04256 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:01.254522 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ccfcae7-d719-4030-a460-835f42a04256 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:01.266734 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ccfcae7-d719-4030-a460-835f42a04256 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:01.268187 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ccfcae7-d719-4030-a460-835f42a04256 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:01.269511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6ccfcae7-d719-4030-a460-835f42a04256 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.270623 Sep 17 21:14:01.270288 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 491/951] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:00 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:01.417868 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fb1d5e2d-1584-4453-aded-4fe14b2eb325 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:01.418613 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fb1d5e2d-1584-4453-aded-4fe14b2eb325 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:01.425827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb1d5e2d-1584-4453-aded-4fe14b2eb325 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:01.426435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb1d5e2d-1584-4453-aded-4fe14b2eb325 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:01.426938 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb1d5e2d-1584-4453-aded-4fe14b2eb325 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:01.427639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb1d5e2d-1584-4453-aded-4fe14b2eb325 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:01.428092 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb1d5e2d-1584-4453-aded-4fe14b2eb325 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:01.428519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb1d5e2d-1584-4453-aded-4fe14b2eb325 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:01.615113 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fb1d5e2d-1584-4453-aded-4fe14b2eb325 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:01.623535 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fb1d5e2d-1584-4453-aded-4fe14b2eb325 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1451 microversion: 2.1 time: 0.209722 Sep 17 21:14:01.624094 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 461/952] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:01 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1451 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:01.645685 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-841d5bae-3127-4a00-ad24-e6919f9f5d55 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:01.646356 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-841d5bae-3127-4a00-ad24-e6919f9f5d55 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:01.652326 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-841d5bae-3127-4a00-ad24-e6919f9f5d55 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:01.654257 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-841d5bae-3127-4a00-ad24-e6919f9f5d55 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:01.654957 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-841d5bae-3127-4a00-ad24-e6919f9f5d55 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:01.655600 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-841d5bae-3127-4a00-ad24-e6919f9f5d55 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:01.656063 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-841d5bae-3127-4a00-ad24-e6919f9f5d55 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:01.656484 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-841d5bae-3127-4a00-ad24-e6919f9f5d55 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:01.809900 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-841d5bae-3127-4a00-ad24-e6919f9f5d55 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:01.818769 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-841d5bae-3127-4a00-ad24-e6919f9f5d55 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1451 microversion: 2.1 time: 0.176873 Sep 17 21:14:01.819350 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 492/953] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:01 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:02.296729 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-138f597f-d453-431c-ad21-e657a8821dfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:02.297664 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-138f597f-d453-431c-ad21-e657a8821dfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:02.304397 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-138f597f-d453-431c-ad21-e657a8821dfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:02.304917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-138f597f-d453-431c-ad21-e657a8821dfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:02.305353 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-138f597f-d453-431c-ad21-e657a8821dfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:02.306223 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-138f597f-d453-431c-ad21-e657a8821dfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:02.306756 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-138f597f-d453-431c-ad21-e657a8821dfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:02.307216 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-138f597f-d453-431c-ad21-e657a8821dfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:02.501962 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-138f597f-d453-431c-ad21-e657a8821dfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:02.510959 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-138f597f-d453-431c-ad21-e657a8821dfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:02.513490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-138f597f-d453-431c-ad21-e657a8821dfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:02.515121 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-138f597f-d453-431c-ad21-e657a8821dfd tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1728 microversion: 2.20 time: 0.223529 Sep 17 21:14:02.515738 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 462/954] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:02 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:03.541908 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2ab6b900-f032-407b-8398-a473b3457926 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:03.542571 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2ab6b900-f032-407b-8398-a473b3457926 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:03.551960 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ab6b900-f032-407b-8398-a473b3457926 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:03.552450 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ab6b900-f032-407b-8398-a473b3457926 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:03.552913 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ab6b900-f032-407b-8398-a473b3457926 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:03.553621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ab6b900-f032-407b-8398-a473b3457926 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:03.554071 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ab6b900-f032-407b-8398-a473b3457926 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:03.554490 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ab6b900-f032-407b-8398-a473b3457926 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:03.920278 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2ab6b900-f032-407b-8398-a473b3457926 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:03.929829 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2ab6b900-f032-407b-8398-a473b3457926 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:03.931277 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2ab6b900-f032-407b-8398-a473b3457926 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:03.932443 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2ab6b900-f032-407b-8398-a473b3457926 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1715 microversion: 2.20 time: 0.395276 Sep 17 21:14:03.933029 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 493/955] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:03 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1715 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:04.657285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7a491a6d-72f4-4b92-9faf-b347353ba499 req-8cf87633-16d0-49c2-979e-2b8213348e23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c20c116-f378-4a7e-812b-45a6824e98ad", "tag": "4c335199-6467-42cd-bd0e-cd87c9b1dac8"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:04.668392 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7a491a6d-72f4-4b92-9faf-b347353ba499 req-8cf87633-16d0-49c2-979e-2b8213348e23 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:04.670381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7a491a6d-72f4-4b92-9faf-b347353ba499 req-8cf87633-16d0-49c2-979e-2b8213348e23 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:04.672178 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7a491a6d-72f4-4b92-9faf-b347353ba499 req-8cf87633-16d0-49c2-979e-2b8213348e23 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:04.688721 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7a491a6d-72f4-4b92-9faf-b347353ba499 req-8cf87633-16d0-49c2-979e-2b8213348e23 service nova] Creating event network-changed:4c335199-6467-42cd-bd0e-cd87c9b1dac8 for instance 0c20c116-f378-4a7e-812b-45a6824e98ad on hv-cinder-82651 Sep 17 21:14:04.695978 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7a491a6d-72f4-4b92-9faf-b347353ba499 req-8cf87633-16d0-49c2-979e-2b8213348e23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043115 Sep 17 21:14:04.696978 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 463/956] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:05.312268 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed360d11-49bb-447a-8676-6d342ee73cd9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:05.313378 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ed360d11-49bb-447a-8676-6d342ee73cd9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:05.320378 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed360d11-49bb-447a-8676-6d342ee73cd9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:05.321111 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed360d11-49bb-447a-8676-6d342ee73cd9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:05.321744 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed360d11-49bb-447a-8676-6d342ee73cd9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:05.322613 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed360d11-49bb-447a-8676-6d342ee73cd9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:05.323346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed360d11-49bb-447a-8676-6d342ee73cd9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:05.323937 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed360d11-49bb-447a-8676-6d342ee73cd9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:05.425024 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-ed360d11-49bb-447a-8676-6d342ee73cd9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lazy-loading 'services' on Instance uuid 7665dbfa-de1c-496f-88cf-c31beb10b5c8 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:14:05.520739 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed360d11-49bb-447a-8676-6d342ee73cd9 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8/os-volume_attachments/352e4c08-beff-4736-aaf3-75850ef190f4" status: 202 len: 0 microversion: 2.1 time: 0.213056 Sep 17 21:14:05.521346 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 494/957] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 17 21:14:05 2022] DELETE /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8/os-volume_attachments/352e4c08-beff-4736-aaf3-75850ef190f4 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:14:05.531148 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-76a19bea-e5ef-40db-b7ac-809cc197d273 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:05.533724 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-76a19bea-e5ef-40db-b7ac-809cc197d273 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:05.549404 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76a19bea-e5ef-40db-b7ac-809cc197d273 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:05.550505 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76a19bea-e5ef-40db-b7ac-809cc197d273 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:05.551182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76a19bea-e5ef-40db-b7ac-809cc197d273 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:05.552095 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76a19bea-e5ef-40db-b7ac-809cc197d273 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:05.552901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76a19bea-e5ef-40db-b7ac-809cc197d273 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:05.553507 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76a19bea-e5ef-40db-b7ac-809cc197d273 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:05.594373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-76a19bea-e5ef-40db-b7ac-809cc197d273 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068149 Sep 17 21:14:05.595072 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 464/958] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:14:05 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:05.838471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76a78efa-e888-4a62-bf2c-72539917204d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:05.839266 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76a78efa-e888-4a62-bf2c-72539917204d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:05.846402 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76a78efa-e888-4a62-bf2c-72539917204d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:05.847115 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76a78efa-e888-4a62-bf2c-72539917204d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:05.847732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76a78efa-e888-4a62-bf2c-72539917204d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:05.848617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76a78efa-e888-4a62-bf2c-72539917204d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:05.849248 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76a78efa-e888-4a62-bf2c-72539917204d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:05.849831 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76a78efa-e888-4a62-bf2c-72539917204d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:05.882596 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76a78efa-e888-4a62-bf2c-72539917204d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments/747a15b2-8d54-405b-baa7-3aa9da0a7fbb" status: 200 len: 194 microversion: 2.1 time: 0.048273 Sep 17 21:14:05.889795 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 495/959] 10.222.0.16 () {58 vars in 1413 bytes} [Sat Sep 17 21:14:05 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments/747a15b2-8d54-405b-baa7-3aa9da0a7fbb => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:05.894810 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b3b4b06-c1b8-422d-bf72-136bacf37eac tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:05.895374 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9b3b4b06-c1b8-422d-bf72-136bacf37eac tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:05.917684 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b3b4b06-c1b8-422d-bf72-136bacf37eac tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:05.918412 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b3b4b06-c1b8-422d-bf72-136bacf37eac tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:05.919464 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b3b4b06-c1b8-422d-bf72-136bacf37eac tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:05.922984 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b3b4b06-c1b8-422d-bf72-136bacf37eac tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:05.923661 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b3b4b06-c1b8-422d-bf72-136bacf37eac tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:05.925159 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b3b4b06-c1b8-422d-bf72-136bacf37eac tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:06.037701 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:06.045894 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-9b3b4b06-c1b8-422d-bf72-136bacf37eac tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lazy-loading 'services' on Instance uuid e2de9d30-c24d-41d2-bbdf-79429561d8d6 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:14:06.167216 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9b3b4b06-c1b8-422d-bf72-136bacf37eac tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments/747a15b2-8d54-405b-baa7-3aa9da0a7fbb" status: 202 len: 0 microversion: 2.1 time: 0.276133 Sep 17 21:14:06.168288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 465/960] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 17 21:14:05 2022] DELETE /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments/747a15b2-8d54-405b-baa7-3aa9da0a7fbb => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:14:06.607489 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c8c6fbd2-fe08-4222-95da-1be8fce2cc85 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:06.610110 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c8c6fbd2-fe08-4222-95da-1be8fce2cc85 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:06.617069 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8c6fbd2-fe08-4222-95da-1be8fce2cc85 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:06.617557 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8c6fbd2-fe08-4222-95da-1be8fce2cc85 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:06.617988 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8c6fbd2-fe08-4222-95da-1be8fce2cc85 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:06.618713 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8c6fbd2-fe08-4222-95da-1be8fce2cc85 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:06.619446 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8c6fbd2-fe08-4222-95da-1be8fce2cc85 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:06.619730 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8c6fbd2-fe08-4222-95da-1be8fce2cc85 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:06.650282 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c8c6fbd2-fe08-4222-95da-1be8fce2cc85 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047015 Sep 17 21:14:06.650828 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 496/961] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:14:06 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:14:06.718972 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07dad380-5c4d-4c63-8aa1-39fa7bf2996c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:06.719558 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07dad380-5c4d-4c63-8aa1-39fa7bf2996c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:06.725760 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07dad380-5c4d-4c63-8aa1-39fa7bf2996c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:06.726243 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07dad380-5c4d-4c63-8aa1-39fa7bf2996c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:06.726669 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07dad380-5c4d-4c63-8aa1-39fa7bf2996c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:06.727529 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07dad380-5c4d-4c63-8aa1-39fa7bf2996c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:06.727976 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07dad380-5c4d-4c63-8aa1-39fa7bf2996c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:06.728556 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07dad380-5c4d-4c63-8aa1-39fa7bf2996c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:06.759217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07dad380-5c4d-4c63-8aa1-39fa7bf2996c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:14:06.853940 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07dad380-5c4d-4c63-8aa1-39fa7bf2996c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 204 len: 0 microversion: 2.1 time: 0.139613 Sep 17 21:14:06.854611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 466/962] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:14:06 2022] DELETE /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:14:06.864510 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1facd032-4781-4b15-9941-53968e981e31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:06.865692 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1facd032-4781-4b15-9941-53968e981e31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:06.872016 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1facd032-4781-4b15-9941-53968e981e31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:06.872727 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1facd032-4781-4b15-9941-53968e981e31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:06.873317 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1facd032-4781-4b15-9941-53968e981e31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:06.874229 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1facd032-4781-4b15-9941-53968e981e31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:06.874791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1facd032-4781-4b15-9941-53968e981e31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:06.875216 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1facd032-4781-4b15-9941-53968e981e31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:07.037546 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1facd032-4781-4b15-9941-53968e981e31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:07.047811 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1facd032-4781-4b15-9941-53968e981e31 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1680 microversion: 2.1 time: 0.187875 Sep 17 21:14:07.048389 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 497/963] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:06 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:07.373063 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-de417cae-5788-4874-8b8e-d0c017ab8355 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:07.376028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de417cae-5788-4874-8b8e-d0c017ab8355 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:07.383174 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de417cae-5788-4874-8b8e-d0c017ab8355 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:07.383668 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de417cae-5788-4874-8b8e-d0c017ab8355 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:07.384106 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de417cae-5788-4874-8b8e-d0c017ab8355 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:07.384859 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de417cae-5788-4874-8b8e-d0c017ab8355 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:07.385343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de417cae-5788-4874-8b8e-d0c017ab8355 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:07.385760 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de417cae-5788-4874-8b8e-d0c017ab8355 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:07.426889 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-de417cae-5788-4874-8b8e-d0c017ab8355 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059298 Sep 17 21:14:07.427798 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 467/964] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:14:07 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:08.071605 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24a869b8-f6c7-4f7a-902c-e5b52ff754e0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:08.072221 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-24a869b8-f6c7-4f7a-902c-e5b52ff754e0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:08.079920 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24a869b8-f6c7-4f7a-902c-e5b52ff754e0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.080550 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24a869b8-f6c7-4f7a-902c-e5b52ff754e0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.081047 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24a869b8-f6c7-4f7a-902c-e5b52ff754e0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:08.081747 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24a869b8-f6c7-4f7a-902c-e5b52ff754e0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.082192 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24a869b8-f6c7-4f7a-902c-e5b52ff754e0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.083016 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24a869b8-f6c7-4f7a-902c-e5b52ff754e0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:08.224694 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-24a869b8-f6c7-4f7a-902c-e5b52ff754e0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:08.232916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24a869b8-f6c7-4f7a-902c-e5b52ff754e0 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1680 microversion: 2.1 time: 0.165219 Sep 17 21:14:08.233485 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 498/965] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:08 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:08.441330 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-45dc19d6-df6f-415d-adbe-7ef56f37d199 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:08.443518 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-45dc19d6-df6f-415d-adbe-7ef56f37d199 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:08.449424 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45dc19d6-df6f-415d-adbe-7ef56f37d199 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.450043 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45dc19d6-df6f-415d-adbe-7ef56f37d199 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.450831 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45dc19d6-df6f-415d-adbe-7ef56f37d199 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:08.451540 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45dc19d6-df6f-415d-adbe-7ef56f37d199 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.452005 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45dc19d6-df6f-415d-adbe-7ef56f37d199 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.452436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45dc19d6-df6f-415d-adbe-7ef56f37d199 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:08.484212 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-45dc19d6-df6f-415d-adbe-7ef56f37d199 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047742 Sep 17 21:14:08.484994 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 468/966] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:14:08 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:14:08.609403 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e553fdd4-6b64-4a6b-8c0e-29671c7f721b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:08.611746 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e553fdd4-6b64-4a6b-8c0e-29671c7f721b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:08.618498 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e553fdd4-6b64-4a6b-8c0e-29671c7f721b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.619274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e553fdd4-6b64-4a6b-8c0e-29671c7f721b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.619727 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e553fdd4-6b64-4a6b-8c0e-29671c7f721b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:08.620459 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e553fdd4-6b64-4a6b-8c0e-29671c7f721b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.620948 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e553fdd4-6b64-4a6b-8c0e-29671c7f721b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.621599 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e553fdd4-6b64-4a6b-8c0e-29671c7f721b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:08.657104 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e553fdd4-6b64-4a6b-8c0e-29671c7f721b tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052476 Sep 17 21:14:08.657787 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 499/967] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:14:08 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:14:08.733612 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9067bdd2-d984-416e-bd11-5460e130cd23 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:08.734551 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9067bdd2-d984-416e-bd11-5460e130cd23 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:08.740905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9067bdd2-d984-416e-bd11-5460e130cd23 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.741549 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9067bdd2-d984-416e-bd11-5460e130cd23 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.742220 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9067bdd2-d984-416e-bd11-5460e130cd23 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:08.743033 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9067bdd2-d984-416e-bd11-5460e130cd23 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.743602 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9067bdd2-d984-416e-bd11-5460e130cd23 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.744121 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9067bdd2-d984-416e-bd11-5460e130cd23 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:08.776189 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9067bdd2-d984-416e-bd11-5460e130cd23 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:14:08.857162 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9067bdd2-d984-416e-bd11-5460e130cd23 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 204 len: 0 microversion: 2.1 time: 0.126655 Sep 17 21:14:08.858052 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 469/968] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:14:08 2022] DELETE /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:14:08.866043 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-64cbbeb5-65bb-4cca-97d1-20c67739f006 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:08.866652 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-64cbbeb5-65bb-4cca-97d1-20c67739f006 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:08.873147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64cbbeb5-65bb-4cca-97d1-20c67739f006 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.873631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64cbbeb5-65bb-4cca-97d1-20c67739f006 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.874068 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64cbbeb5-65bb-4cca-97d1-20c67739f006 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:08.874768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64cbbeb5-65bb-4cca-97d1-20c67739f006 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.875227 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64cbbeb5-65bb-4cca-97d1-20c67739f006 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.875649 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64cbbeb5-65bb-4cca-97d1-20c67739f006 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:09.006693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-64cbbeb5-65bb-4cca-97d1-20c67739f006 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:09.015080 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-64cbbeb5-65bb-4cca-97d1-20c67739f006 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1673 microversion: 2.1 time: 0.152908 Sep 17 21:14:09.015667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 500/969] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:08 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:14:09.259317 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1299092-15d4-46ba-8a58-97ff979eb505 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:09.259949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1299092-15d4-46ba-8a58-97ff979eb505 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:09.265888 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1299092-15d4-46ba-8a58-97ff979eb505 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:09.266370 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1299092-15d4-46ba-8a58-97ff979eb505 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:09.266799 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1299092-15d4-46ba-8a58-97ff979eb505 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:09.267483 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1299092-15d4-46ba-8a58-97ff979eb505 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:09.267930 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1299092-15d4-46ba-8a58-97ff979eb505 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:09.268345 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1299092-15d4-46ba-8a58-97ff979eb505 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:09.399870 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c1299092-15d4-46ba-8a58-97ff979eb505 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:09.408587 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1299092-15d4-46ba-8a58-97ff979eb505 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1680 microversion: 2.1 time: 0.153492 Sep 17 21:14:09.409323 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 470/970] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:09 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:09.723967 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-91877e1f-91e9-418f-9ab7-143a68bc3f4a req-5cb83cfb-c53c-49e2-9185-d0a4dad2abc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7665dbfa-de1c-496f-88cf-c31beb10b5c8", "name": "network-vif-deleted", "tag": "d054d99f-b752-4115-b6d8-e10e63d40716"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:09.734103 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-91877e1f-91e9-418f-9ab7-143a68bc3f4a req-5cb83cfb-c53c-49e2-9185-d0a4dad2abc3 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:09.734578 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-91877e1f-91e9-418f-9ab7-143a68bc3f4a req-5cb83cfb-c53c-49e2-9185-d0a4dad2abc3 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:09.735031 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-91877e1f-91e9-418f-9ab7-143a68bc3f4a req-5cb83cfb-c53c-49e2-9185-d0a4dad2abc3 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:09.746279 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-91877e1f-91e9-418f-9ab7-143a68bc3f4a req-5cb83cfb-c53c-49e2-9185-d0a4dad2abc3 service nova] Creating event network-vif-deleted:d054d99f-b752-4115-b6d8-e10e63d40716 for instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 on hv-cinder-82651 Sep 17 21:14:09.751733 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-91877e1f-91e9-418f-9ab7-143a68bc3f4a req-5cb83cfb-c53c-49e2-9185-d0a4dad2abc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031497 Sep 17 21:14:09.752313 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 501/971] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:10.040070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-43f6142d-2e57-4eaa-b545-e5d1a23966b0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:10.040831 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-43f6142d-2e57-4eaa-b545-e5d1a23966b0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:10.049760 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43f6142d-2e57-4eaa-b545-e5d1a23966b0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:10.050772 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43f6142d-2e57-4eaa-b545-e5d1a23966b0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:10.051170 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43f6142d-2e57-4eaa-b545-e5d1a23966b0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:10.051939 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43f6142d-2e57-4eaa-b545-e5d1a23966b0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:10.052448 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43f6142d-2e57-4eaa-b545-e5d1a23966b0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:10.052973 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43f6142d-2e57-4eaa-b545-e5d1a23966b0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:10.198378 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-43f6142d-2e57-4eaa-b545-e5d1a23966b0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:10.206866 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-43f6142d-2e57-4eaa-b545-e5d1a23966b0 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1673 microversion: 2.1 time: 0.171345 Sep 17 21:14:10.207445 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 471/972] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:10 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:10.433323 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:10.434011 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:10.442899 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:10.443394 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:10.443977 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:10.444711 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:10.445171 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:10.445598 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:10.477749 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:10.478404 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:10.478846 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:10.479395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lazy-loading 'fault' on Instance uuid 7665dbfa-de1c-496f-88cf-c31beb10b5c8 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:14:10.531168 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3b1e0f4888400b89c47b3e44443228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9689fd1a04647cf91a73680e4b677d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:10.540293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6ebbb892-80cd-44b8-974d-e0c0207a302b tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 200 len: 1331 microversion: 2.1 time: 0.111252 Sep 17 21:14:10.540959 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 502/973] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:10 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:11.230500 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-217962ef-506b-4f56-bae8-d523d6d57a0f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:11.231547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-217962ef-506b-4f56-bae8-d523d6d57a0f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:11.237917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-217962ef-506b-4f56-bae8-d523d6d57a0f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:11.238403 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-217962ef-506b-4f56-bae8-d523d6d57a0f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:11.238838 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-217962ef-506b-4f56-bae8-d523d6d57a0f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:11.239528 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-217962ef-506b-4f56-bae8-d523d6d57a0f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:11.240014 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-217962ef-506b-4f56-bae8-d523d6d57a0f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:11.240525 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-217962ef-506b-4f56-bae8-d523d6d57a0f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:11.369237 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-217962ef-506b-4f56-bae8-d523d6d57a0f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:11.379985 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-217962ef-506b-4f56-bae8-d523d6d57a0f tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1673 microversion: 2.1 time: 0.153269 Sep 17 21:14:11.380570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 472/974] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:11 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:11.564233 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5d25742-236b-4b31-9716-da46f24823a8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:11.565351 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b5d25742-236b-4b31-9716-da46f24823a8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:11.572323 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5d25742-236b-4b31-9716-da46f24823a8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:11.572860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5d25742-236b-4b31-9716-da46f24823a8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:11.573299 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5d25742-236b-4b31-9716-da46f24823a8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:11.574025 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5d25742-236b-4b31-9716-da46f24823a8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:11.574472 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5d25742-236b-4b31-9716-da46f24823a8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:11.575537 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5d25742-236b-4b31-9716-da46f24823a8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:11.589005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b5d25742-236b-4b31-9716-da46f24823a8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5d25742-236b-4b31-9716-da46f24823a8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 HTTP/1.1 Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:14:11.591379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:14:11.592973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:11.592973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:11.592973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:11.592973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:11.592973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:11.592973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:14:11.592973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:14:11.592973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:14:11.592973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:11.592973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:14:11.592973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:11.592973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '7665dbfa-de1c-496f-88cf-c31beb10b5c8'} Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:11.593857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:11.595055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:11.596147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5d25742-236b-4b31-9716-da46f24823a8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 404 to user: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:11.596147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5d25742-236b-4b31-9716-da46f24823a8 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 404 len: 111 microversion: 2.1 time: 0.032475 Sep 17 21:14:11.596147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 503/975] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:11 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:11.602387 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-edc84929-cc27-481a-8fb0-6c2c9e113f52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '.version_select at 0x7f9baad36c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:11.625682 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-edc84929-cc27-481a-8fb0-6c2c9e113f52 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857807033" status: 202 len: 0 microversion: 2.1 time: 0.027608 Sep 17 21:14:11.626268 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 473/976] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 17 21:14:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857807033 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:14:11.899648 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-25d3514c-a577-4c51-b17f-dfb8dbd77fc2 req-c9344f74-89da-4acf-b2d0-021e415d2abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2de9d30-c24d-41d2-bbdf-79429561d8d6", "name": "network-vif-deleted", "tag": "8bdcaef8-e19b-4b96-847b-f6bbb29f455b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:11.914489 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-25d3514c-a577-4c51-b17f-dfb8dbd77fc2 req-c9344f74-89da-4acf-b2d0-021e415d2abc service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:11.914976 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-25d3514c-a577-4c51-b17f-dfb8dbd77fc2 req-c9344f74-89da-4acf-b2d0-021e415d2abc service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:11.915411 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-25d3514c-a577-4c51-b17f-dfb8dbd77fc2 req-c9344f74-89da-4acf-b2d0-021e415d2abc service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:11.941584 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-25d3514c-a577-4c51-b17f-dfb8dbd77fc2 req-c9344f74-89da-4acf-b2d0-021e415d2abc service nova] Creating event network-vif-deleted:8bdcaef8-e19b-4b96-847b-f6bbb29f455b for instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 on hv-cinder-82651 Sep 17 21:14:11.947760 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-25d3514c-a577-4c51-b17f-dfb8dbd77fc2 req-c9344f74-89da-4acf-b2d0-021e415d2abc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054112 Sep 17 21:14:11.949499 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 504/977] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:12.414775 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:12.415456 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:12.422677 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:12.423592 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:12.424093 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:12.424901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:12.425421 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:12.425910 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:12.459571 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:12.460127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:12.460628 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:12.461157 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lazy-loading 'fault' on Instance uuid e2de9d30-c24d-41d2-bbdf-79429561d8d6 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:14:12.513863 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5e98fb43a143ea8cfa30990b4fffc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae15e7cf5d74f9f90e067bb801c7e95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:12.523591 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-930838b9-068e-4616-b8e5-e625f7ef3642 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 200 len: 1327 microversion: 2.1 time: 0.119445 Sep 17 21:14:12.524539 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 474/978] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:12 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:13.442284 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dda9fd62-0fe8-4939-8a74-44024448ea21 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:13.442866 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dda9fd62-0fe8-4939-8a74-44024448ea21 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:13.449457 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda9fd62-0fe8-4939-8a74-44024448ea21 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:13.450077 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda9fd62-0fe8-4939-8a74-44024448ea21 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:13.450515 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda9fd62-0fe8-4939-8a74-44024448ea21 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:13.451212 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda9fd62-0fe8-4939-8a74-44024448ea21 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:13.451668 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda9fd62-0fe8-4939-8a74-44024448ea21 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:13.452092 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda9fd62-0fe8-4939-8a74-44024448ea21 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:13.465178 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-dda9fd62-0fe8-4939-8a74-44024448ea21 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dda9fd62-0fe8-4939-8a74-44024448ea21 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 HTTP/1.1 Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:14:13.466794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:14:13.468440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:13.468440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:13.468440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:13.468440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:13.468440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:13.468440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:14:13.468440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:14:13.468440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:14:13.468440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:13.468440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:14:13.468440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:13.468440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '7665dbfa-de1c-496f-88cf-c31beb10b5c8'} Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:13.469492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:13.470931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.472488 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dda9fd62-0fe8-4939-8a74-44024448ea21 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 404 to user: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:13.472488 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dda9fd62-0fe8-4939-8a74-44024448ea21 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 404 len: 111 microversion: 2.1 time: 0.030387 Sep 17 21:14:13.472488 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 505/979] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:14:13 2022] DELETE /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:13.476891 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ef1a79a-503d-4010-aa40-edfa5c7d4df3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:13.477499 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0ef1a79a-503d-4010-aa40-edfa5c7d4df3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 7665dbfa-de1c-496f-88cf-c31beb10b5c8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:13.484486 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ef1a79a-503d-4010-aa40-edfa5c7d4df3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:13.484988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ef1a79a-503d-4010-aa40-edfa5c7d4df3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:13.485419 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ef1a79a-503d-4010-aa40-edfa5c7d4df3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:13.486102 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ef1a79a-503d-4010-aa40-edfa5c7d4df3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:13.486548 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ef1a79a-503d-4010-aa40-edfa5c7d4df3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:13.486978 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ef1a79a-503d-4010-aa40-edfa5c7d4df3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:13.500846 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-0ef1a79a-503d-4010-aa40-edfa5c7d4df3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ef1a79a-503d-4010-aa40-edfa5c7d4df3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 HTTP/1.1 Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:14:13.502492 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:14:13.504041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:13.504041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:13.504041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:13.504041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:13.504041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:13.504041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:14:13.504041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:14:13.504041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:14:13.504041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:13.504041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:14:13.504041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:13.504041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '7665dbfa-de1c-496f-88cf-c31beb10b5c8'} Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:13.505117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. Sep 17 21:14:13.506585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.508003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ef1a79a-503d-4010-aa40-edfa5c7d4df3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 404 to user: Instance 7665dbfa-de1c-496f-88cf-c31beb10b5c8 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:13.508003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0ef1a79a-503d-4010-aa40-edfa5c7d4df3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8" status: 404 len: 111 microversion: 2.1 time: 0.031233 Sep 17 21:14:13.508003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 475/980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:13 2022] GET /compute/v2.1/servers/7665dbfa-de1c-496f-88cf-c31beb10b5c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:13.548553 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-befee7f7-d5b7-4312-aa34-1eba9fc208ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:13.549181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-befee7f7-d5b7-4312-aa34-1eba9fc208ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:13.555070 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befee7f7-d5b7-4312-aa34-1eba9fc208ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:13.555641 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befee7f7-d5b7-4312-aa34-1eba9fc208ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:13.556128 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befee7f7-d5b7-4312-aa34-1eba9fc208ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:13.556921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befee7f7-d5b7-4312-aa34-1eba9fc208ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:13.557606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befee7f7-d5b7-4312-aa34-1eba9fc208ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:13.558037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befee7f7-d5b7-4312-aa34-1eba9fc208ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:13.560796 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:13.577865 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-befee7f7-d5b7-4312-aa34-1eba9fc208ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] HTTP exception thrown: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-befee7f7-d5b7-4312-aa34-1eba9fc208ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Request method failure captured: Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 HTTP/1.1 Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZdobnJlAYXfZpHtDmHGZcwMqCN44aDair10sFGHblIDg45v-i-tGl0WQpq7KmHbxM8Dfpp4n5jBl6WFGL-d4YWmngCF8HWtFZA63GzYJAYXl0gXTMOikdnejMoDzQD2UTDa7ez7pEUPvzMOI2-cMyu83-bg9u8AQwXTlT74Kty4yw Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: aae15e7cf5d74f9f90e067bb801c7e95 Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:14:13.579386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:14:13.581005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:13.581005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:13.581005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: aae15e7cf5d74f9f90e067bb801c7e95 Sep 17 21:14:13.581005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:13.581005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeTestJSON-402069048-project Sep 17 21:14:13.581005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:14:13.581005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:14:13.581005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 4b5e98fb43a143ea8cfa30990b4fffc2 Sep 17 21:14:13.581005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeTestJSON-402069048-project Sep 17 21:14:13.581005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:14:13.581005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:13.581005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': 'e2de9d30-c24d-41d2-bbdf-79429561d8d6'} Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:13.581765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:13.582993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:13.584156 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-befee7f7-d5b7-4312-aa34-1eba9fc208ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Returning 404 to user: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:13.584156 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-befee7f7-d5b7-4312-aa34-1eba9fc208ef tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 404 len: 111 microversion: 2.1 time: 0.037210 Sep 17 21:14:13.584156 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 506/981] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:13 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:13.590137 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-852b5adb-0ecc-4437-930a-42330e4685aa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '.version_select at 0x7f9baac5be50>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:13.611384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-852b5adb-0ecc-4437-930a-42330e4685aa tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463632855" status: 202 len: 0 microversion: 2.1 time: 0.025282 Sep 17 21:14:13.611954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 476/982] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 17 21:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463632855 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:14:14.653118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03e32ff6-42d4-4b78-9625-48f65c7fc1b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:14.653699 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-03e32ff6-42d4-4b78-9625-48f65c7fc1b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:14.660099 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03e32ff6-42d4-4b78-9625-48f65c7fc1b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:14.660577 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03e32ff6-42d4-4b78-9625-48f65c7fc1b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:14.661049 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03e32ff6-42d4-4b78-9625-48f65c7fc1b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:14.661738 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03e32ff6-42d4-4b78-9625-48f65c7fc1b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:14.662190 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03e32ff6-42d4-4b78-9625-48f65c7fc1b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:14.662606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03e32ff6-42d4-4b78-9625-48f65c7fc1b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:14.676305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-03e32ff6-42d4-4b78-9625-48f65c7fc1b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03e32ff6-42d4-4b78-9625-48f65c7fc1b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 HTTP/1.1 Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:14:14.677851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:14:14.679395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:14.679395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:14.679395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:14.679395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:14.679395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:14.679395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:14:14.679395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:14:14.679395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:14:14.679395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:14.679395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:14:14.679395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:14:14.679395 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '26f1be29-b81c-4f72-99e3-979c1aab0af2'} Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:14.680300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:14:14.681748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.683636 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03e32ff6-42d4-4b78-9625-48f65c7fc1b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 404 to user: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:14.683636 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-03e32ff6-42d4-4b78-9625-48f65c7fc1b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 404 len: 111 microversion: 2.1 time: 0.029915 Sep 17 21:14:14.683636 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 507/983] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:14:14 2022] DELETE /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:14.688540 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-643b32e8-664b-467c-99c0-8710b6c245b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:14.689186 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-643b32e8-664b-467c-99c0-8710b6c245b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 26f1be29-b81c-4f72-99e3-979c1aab0af2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:14.696117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-643b32e8-664b-467c-99c0-8710b6c245b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:14.696639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-643b32e8-664b-467c-99c0-8710b6c245b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:14.697103 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-643b32e8-664b-467c-99c0-8710b6c245b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:14.697780 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-643b32e8-664b-467c-99c0-8710b6c245b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:14.698226 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-643b32e8-664b-467c-99c0-8710b6c245b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:14.698643 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-643b32e8-664b-467c-99c0-8710b6c245b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:14.711751 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-643b32e8-664b-467c-99c0-8710b6c245b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-643b32e8-664b-467c-99c0-8710b6c245b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 HTTP/1.1 Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:14:14.713381 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:14:14.714908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:14.714908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:14.714908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:14.714908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:14.714908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:14.714908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:14:14.714908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:14:14.714908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:14:14.714908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:14.714908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:14:14.714908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:14:14.714908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '26f1be29-b81c-4f72-99e3-979c1aab0af2'} Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:14.715827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. Sep 17 21:14:14.717436 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.719166 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-643b32e8-664b-467c-99c0-8710b6c245b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 404 to user: Instance 26f1be29-b81c-4f72-99e3-979c1aab0af2 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:14.719166 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-643b32e8-664b-467c-99c0-8710b6c245b1 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2" status: 404 len: 111 microversion: 2.1 time: 0.031116 Sep 17 21:14:14.719166 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 477/984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:14 2022] GET /compute/v2.1/servers/26f1be29-b81c-4f72-99e3-979c1aab0af2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:14.723358 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a53215ed-e07d-4d5b-bb89-e1dbaee0a7e3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:14.723857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a53215ed-e07d-4d5b-bb89-e1dbaee0a7e3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:14.729710 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a53215ed-e07d-4d5b-bb89-e1dbaee0a7e3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:14.730196 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a53215ed-e07d-4d5b-bb89-e1dbaee0a7e3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:14.730666 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a53215ed-e07d-4d5b-bb89-e1dbaee0a7e3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:14.732091 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a53215ed-e07d-4d5b-bb89-e1dbaee0a7e3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:14.732553 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a53215ed-e07d-4d5b-bb89-e1dbaee0a7e3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:14.733017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a53215ed-e07d-4d5b-bb89-e1dbaee0a7e3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:14.745984 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-a53215ed-e07d-4d5b-bb89-e1dbaee0a7e3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a53215ed-e07d-4d5b-bb89-e1dbaee0a7e3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e HTTP/1.1 Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:14:14.747581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:14:14.749165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:14.749165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:14.749165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:14.749165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:14.749165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:14.749165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:14:14.749165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:14:14.749165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:14:14.749165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:14.749165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:14:14.749165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:14:14.749165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '33fe9079-6aa4-43be-b5d0-8f5df95a890e'} Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:14.750035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:14:14.751540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.753134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a53215ed-e07d-4d5b-bb89-e1dbaee0a7e3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 404 to user: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:14.753134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a53215ed-e07d-4d5b-bb89-e1dbaee0a7e3 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 404 len: 111 microversion: 2.1 time: 0.029503 Sep 17 21:14:14.753134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 508/985] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:14:14 2022] DELETE /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:14.757308 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-43edf4e3-a2f9-4c49-8e0a-388dd9ea8b1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:14.757923 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-43edf4e3-a2f9-4c49-8e0a-388dd9ea8b1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: 33fe9079-6aa4-43be-b5d0-8f5df95a890e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:14.764469 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43edf4e3-a2f9-4c49-8e0a-388dd9ea8b1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:14.764988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43edf4e3-a2f9-4c49-8e0a-388dd9ea8b1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:14.765429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43edf4e3-a2f9-4c49-8e0a-388dd9ea8b1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:14.766138 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43edf4e3-a2f9-4c49-8e0a-388dd9ea8b1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:14.766599 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43edf4e3-a2f9-4c49-8e0a-388dd9ea8b1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:14.767031 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43edf4e3-a2f9-4c49-8e0a-388dd9ea8b1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:14.782965 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-43edf4e3-a2f9-4c49-8e0a-388dd9ea8b1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-43edf4e3-a2f9-4c49-8e0a-388dd9ea8b1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e HTTP/1.1 Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:14:14.784536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:14:14.786236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:14.786236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:14.786236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:14.786236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:14.786236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:14.786236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:14:14.786236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:14:14.786236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:14:14.786236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:14.786236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:14:14.786236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:14:14.786236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '33fe9079-6aa4-43be-b5d0-8f5df95a890e'} Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:14.787239 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. Sep 17 21:14:14.788841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:14.790184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-43edf4e3-a2f9-4c49-8e0a-388dd9ea8b1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 404 to user: Instance 33fe9079-6aa4-43be-b5d0-8f5df95a890e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:14.790184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-43edf4e3-a2f9-4c49-8e0a-388dd9ea8b1a tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e" status: 404 len: 111 microversion: 2.1 time: 0.032427 Sep 17 21:14:14.790184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 478/986] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:14 2022] GET /compute/v2.1/servers/33fe9079-6aa4-43be-b5d0-8f5df95a890e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:15.925053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f717202-f62e-4981-b415-1fb92704a09c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:15.925537 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3f717202-f62e-4981-b415-1fb92704a09c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:15.931813 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f717202-f62e-4981-b415-1fb92704a09c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:15.932295 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f717202-f62e-4981-b415-1fb92704a09c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:15.932764 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f717202-f62e-4981-b415-1fb92704a09c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:15.933469 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f717202-f62e-4981-b415-1fb92704a09c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:15.933913 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f717202-f62e-4981-b415-1fb92704a09c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:15.934338 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f717202-f62e-4981-b415-1fb92704a09c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:15.947767 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-3f717202-f62e-4981-b415-1fb92704a09c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f717202-f62e-4981-b415-1fb92704a09c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e HTTP/1.1 Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:14:15.949335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:14:15.950903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:15.950903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:15.950903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:15.950903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:15.950903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:15.950903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:14:15.950903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:14:15.950903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:14:15.950903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:15.950903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:14:15.950903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:14:15.950903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': 'b38b7550-7fb1-4104-b38d-6ae86dbe3a1e'} Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:15.951955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:14:15.953464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:15.955069 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f717202-f62e-4981-b415-1fb92704a09c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 404 to user: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:15.955069 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3f717202-f62e-4981-b415-1fb92704a09c tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 404 len: 111 microversion: 2.1 time: 0.029481 Sep 17 21:14:15.955069 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 509/987] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:14:15 2022] DELETE /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:14:15.959198 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e2ddab1-654c-47dc-b669-203fb1a31359 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:15.959805 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8e2ddab1-654c-47dc-b669-203fb1a31359 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] [instance: b38b7550-7fb1-4104-b38d-6ae86dbe3a1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:15.966601 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e2ddab1-654c-47dc-b669-203fb1a31359 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:15.967073 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e2ddab1-654c-47dc-b669-203fb1a31359 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:15.967531 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e2ddab1-654c-47dc-b669-203fb1a31359 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:15.968209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e2ddab1-654c-47dc-b669-203fb1a31359 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:15.968654 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e2ddab1-654c-47dc-b669-203fb1a31359 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:15.969099 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e2ddab1-654c-47dc-b669-203fb1a31359 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:15.983116 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-8e2ddab1-654c-47dc-b669-203fb1a31359 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] HTTP exception thrown: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e2ddab1-654c-47dc-b669-203fb1a31359 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Request method failure captured: Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e HTTP/1.1 Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZdRvJGmkNR97TeSBp27PCd1Xy2X8X3cpqfgYFoDAYAAoeQE_541iiA9n04oYF0R4gC1mMQNm5DGsjzeqowJr_eZkCUMsvE4zRciXX3maeoGTTxIbbBH0tmKens1nMjs4RCGcLFKF7z8x9p1qazeOupUVijL92HwOzuJzDIbRHiS7M Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:14:15.984624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:14:15.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9689fd1a04647cf91a73680e4b677d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:15.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:15.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d9689fd1a04647cf91a73680e4b677d1 Sep 17 21:14:15.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-506376647 Sep 17 21:14:15.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:15.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:14:15.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:14:15.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1e3b1e0f4888400b89c47b3e44443228 Sep 17 21:14:15.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-506376647-project Sep 17 21:14:15.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:14:15.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:14:15.986272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': 'b38b7550-7fb1-4104-b38d-6ae86dbe3a1e'} Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:15.990468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. Sep 17 21:14:15.992344 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:15.993744 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e2ddab1-654c-47dc-b669-203fb1a31359 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] Returning 404 to user: Instance b38b7550-7fb1-4104-b38d-6ae86dbe3a1e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:15.993744 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8e2ddab1-654c-47dc-b669-203fb1a31359 tempest-AttachVolumeNegativeTest-506376647 tempest-AttachVolumeNegativeTest-506376647-project] 10.222.0.16 "GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e" status: 404 len: 111 microversion: 2.1 time: 0.030658 Sep 17 21:14:15.993744 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 479/988] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:15 2022] GET /compute/v2.1/servers/b38b7550-7fb1-4104-b38d-6ae86dbe3a1e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:16.456092 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a3fc1d0b-955c-4a02-9d35-9c2708ef3380 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:16.456594 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a3fc1d0b-955c-4a02-9d35-9c2708ef3380 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:16.462449 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3fc1d0b-955c-4a02-9d35-9c2708ef3380 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:16.462936 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3fc1d0b-955c-4a02-9d35-9c2708ef3380 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:16.463373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3fc1d0b-955c-4a02-9d35-9c2708ef3380 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:16.464072 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3fc1d0b-955c-4a02-9d35-9c2708ef3380 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:16.464531 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3fc1d0b-955c-4a02-9d35-9c2708ef3380 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:16.464988 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3fc1d0b-955c-4a02-9d35-9c2708ef3380 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:16.478882 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-a3fc1d0b-955c-4a02-9d35-9c2708ef3380 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] HTTP exception thrown: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a3fc1d0b-955c-4a02-9d35-9c2708ef3380 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Request method failure captured: Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 HTTP/1.1 Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZdobnJlAYXfZpHtDmHGZcwMqCN44aDair10sFGHblIDg45v-i-tGl0WQpq7KmHbxM8Dfpp4n5jBl6WFGL-d4YWmngCF8HWtFZA63GzYJAYXl0gXTMOikdnejMoDzQD2UTDa7ez7pEUPvzMOI2-cMyu83-bg9u8AQwXTlT74Kty4yw Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: aae15e7cf5d74f9f90e067bb801c7e95 Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:14:16.480423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:14:16.482318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:16.482318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:16.482318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: aae15e7cf5d74f9f90e067bb801c7e95 Sep 17 21:14:16.482318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:16.482318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeTestJSON-402069048-project Sep 17 21:14:16.482318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:14:16.482318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:14:16.482318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 4b5e98fb43a143ea8cfa30990b4fffc2 Sep 17 21:14:16.482318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeTestJSON-402069048-project Sep 17 21:14:16.482318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:14:16.482318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:16.482318 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': 'e2de9d30-c24d-41d2-bbdf-79429561d8d6'} Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:16.483139 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:16.484754 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:16.486805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a3fc1d0b-955c-4a02-9d35-9c2708ef3380 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Returning 404 to user: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:16.486805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a3fc1d0b-955c-4a02-9d35-9c2708ef3380 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 404 len: 111 microversion: 2.1 time: 0.029615 Sep 17 21:14:16.486805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 510/989] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:14:16 2022] DELETE /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:14:16.491097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11568e6a-28bd-419e-8c00-ff5ace9593d5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:16.491753 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-11568e6a-28bd-419e-8c00-ff5ace9593d5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: e2de9d30-c24d-41d2-bbdf-79429561d8d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:16.497842 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11568e6a-28bd-419e-8c00-ff5ace9593d5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:16.498433 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11568e6a-28bd-419e-8c00-ff5ace9593d5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:16.498975 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11568e6a-28bd-419e-8c00-ff5ace9593d5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:16.499719 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11568e6a-28bd-419e-8c00-ff5ace9593d5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:16.501295 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11568e6a-28bd-419e-8c00-ff5ace9593d5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:16.501295 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11568e6a-28bd-419e-8c00-ff5ace9593d5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:16.514258 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-11568e6a-28bd-419e-8c00-ff5ace9593d5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] HTTP exception thrown: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11568e6a-28bd-419e-8c00-ff5ace9593d5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Request method failure captured: Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 HTTP/1.1 Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZdobnJlAYXfZpHtDmHGZcwMqCN44aDair10sFGHblIDg45v-i-tGl0WQpq7KmHbxM8Dfpp4n5jBl6WFGL-d4YWmngCF8HWtFZA63GzYJAYXl0gXTMOikdnejMoDzQD2UTDa7ez7pEUPvzMOI2-cMyu83-bg9u8AQwXTlT74Kty4yw Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: aae15e7cf5d74f9f90e067bb801c7e95 Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:14:16.515840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:14:16.517384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:16.517384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:16.517384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: aae15e7cf5d74f9f90e067bb801c7e95 Sep 17 21:14:16.517384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:16.517384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeTestJSON-402069048-project Sep 17 21:14:16.517384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:14:16.517384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:14:16.517384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 4b5e98fb43a143ea8cfa30990b4fffc2 Sep 17 21:14:16.517384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeTestJSON-402069048-project Sep 17 21:14:16.517384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:14:16.517384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:16.517384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': 'e2de9d30-c24d-41d2-bbdf-79429561d8d6'} Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:16.518269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. Sep 17 21:14:16.519783 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:16.521232 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11568e6a-28bd-419e-8c00-ff5ace9593d5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Returning 404 to user: Instance e2de9d30-c24d-41d2-bbdf-79429561d8d6 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:16.521232 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-11568e6a-28bd-419e-8c00-ff5ace9593d5 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6" status: 404 len: 111 microversion: 2.1 time: 0.030027 Sep 17 21:14:16.523261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 480/990] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:16 2022] GET /compute/v2.1/servers/e2de9d30-c24d-41d2-bbdf-79429561d8d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:17.658083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-90075aee-03ec-4e9e-ab3e-990faff19282 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:17.658629 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-90075aee-03ec-4e9e-ab3e-990faff19282 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:17.665081 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90075aee-03ec-4e9e-ab3e-990faff19282 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:17.665563 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90075aee-03ec-4e9e-ab3e-990faff19282 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:17.665997 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90075aee-03ec-4e9e-ab3e-990faff19282 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:17.666682 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90075aee-03ec-4e9e-ab3e-990faff19282 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:17.667134 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90075aee-03ec-4e9e-ab3e-990faff19282 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:17.667552 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90075aee-03ec-4e9e-ab3e-990faff19282 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:17.681166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-90075aee-03ec-4e9e-ab3e-990faff19282 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] HTTP exception thrown: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-90075aee-03ec-4e9e-ab3e-990faff19282 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Request method failure captured: Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 HTTP/1.1 Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjZdobnJlAYXfZpHtDmHGZcwMqCN44aDair10sFGHblIDg45v-i-tGl0WQpq7KmHbxM8Dfpp4n5jBl6WFGL-d4YWmngCF8HWtFZA63GzYJAYXl0gXTMOikdnejMoDzQD2UTDa7ez7pEUPvzMOI2-cMyu83-bg9u8AQwXTlT74Kty4yw Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: aae15e7cf5d74f9f90e067bb801c7e95 Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:14:17.682729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:14:17.684261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:17.684261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:17.684261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: aae15e7cf5d74f9f90e067bb801c7e95 Sep 17 21:14:17.684261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:17.684261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeTestJSON-402069048-project Sep 17 21:14:17.684261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:14:17.684261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:14:17.684261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 4b5e98fb43a143ea8cfa30990b4fffc2 Sep 17 21:14:17.684261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeTestJSON-402069048-project Sep 17 21:14:17.684261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:14:17.684261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:14:17.684261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '2b31e9e6-6a1c-44e8-bcdc-28130872f747'} Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:17.685741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:14:17.687076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:17.689539 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-90075aee-03ec-4e9e-ab3e-990faff19282 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Returning 404 to user: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:17.689539 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-90075aee-03ec-4e9e-ab3e-990faff19282 tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 404 len: 111 microversion: 2.1 time: 0.029844 Sep 17 21:14:17.689539 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 511/991] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:14:17 2022] DELETE /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:17.693603 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-19b8fd0b-20d9-4b5f-966d-447414b9583d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:17.694212 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-19b8fd0b-20d9-4b5f-966d-447414b9583d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] [instance: 2b31e9e6-6a1c-44e8-bcdc-28130872f747] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:17.701144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19b8fd0b-20d9-4b5f-966d-447414b9583d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:17.701544 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19b8fd0b-20d9-4b5f-966d-447414b9583d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:17.701974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19b8fd0b-20d9-4b5f-966d-447414b9583d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:17.702663 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19b8fd0b-20d9-4b5f-966d-447414b9583d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:17.703111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19b8fd0b-20d9-4b5f-966d-447414b9583d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:17.703531 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19b8fd0b-20d9-4b5f-966d-447414b9583d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:17.716785 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-19b8fd0b-20d9-4b5f-966d-447414b9583d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] HTTP exception thrown: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-19b8fd0b-20d9-4b5f-966d-447414b9583d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Request method failure captured: Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 HTTP/1.1 Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjZdobnJlAYXfZpHtDmHGZcwMqCN44aDair10sFGHblIDg45v-i-tGl0WQpq7KmHbxM8Dfpp4n5jBl6WFGL-d4YWmngCF8HWtFZA63GzYJAYXl0gXTMOikdnejMoDzQD2UTDa7ez7pEUPvzMOI2-cMyu83-bg9u8AQwXTlT74Kty4yw Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: aae15e7cf5d74f9f90e067bb801c7e95 Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:14:17.721091 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:14:17.722504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aae15e7cf5d74f9f90e067bb801c7e95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:17.722504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:17.722504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: aae15e7cf5d74f9f90e067bb801c7e95 Sep 17 21:14:17.722504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402069048 Sep 17 21:14:17.722504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeTestJSON-402069048-project Sep 17 21:14:17.722504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:14:17.722504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:14:17.722504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 4b5e98fb43a143ea8cfa30990b4fffc2 Sep 17 21:14:17.722504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeTestJSON-402069048-project Sep 17 21:14:17.722504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:14:17.722504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:14:17.722504 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '2b31e9e6-6a1c-44e8-bcdc-28130872f747'} Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:17.723451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. Sep 17 21:14:17.725021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:17.726569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-19b8fd0b-20d9-4b5f-966d-447414b9583d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] Returning 404 to user: Instance 2b31e9e6-6a1c-44e8-bcdc-28130872f747 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:17.726569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-19b8fd0b-20d9-4b5f-966d-447414b9583d tempest-AttachVolumeTestJSON-402069048 tempest-AttachVolumeTestJSON-402069048-project] 10.222.0.16 "GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747" status: 404 len: 111 microversion: 2.1 time: 0.032954 Sep 17 21:14:17.726569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 481/992] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:17 2022] GET /compute/v2.1/servers/2b31e9e6-6a1c-44e8-bcdc-28130872f747 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:20.931079 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da2baf60-4065-4b76-a633-dae02b7c7e31 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Action: 'create', calling method: .version_select at 0x7f9ba7435b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1340047419"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:21.463538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da2baf60-4065-4b76-a633-dae02b7c7e31 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.680382 Sep 17 21:14:21.464184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 512/993] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Sep 17 21:14:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 682 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 17 21:14:21.479997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8491d7a0-55b0-4b14-a21f-49bb6ef0ebb1 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9baaccee50>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:21.613447 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8491d7a0-55b0-4b14-a21f-49bb6ef0ebb1 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92" status: 200 len: 345 microversion: 2.1 time: 0.139022 Sep 17 21:14:21.614006 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 482/994] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:14:21 2022] GET /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92 => generated 345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:22.628927 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-791125bc-9389-4e4f-b18e-b97e74c1b141 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9ba72f4ca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:22.678143 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-791125bc-9389-4e4f-b18e-b97e74c1b141 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92" status: 200 len: 346 microversion: 2.1 time: 0.053568 Sep 17 21:14:22.678813 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 513/995] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:14:22 2022] GET /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:22.693804 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef0c2200-6739-4f82-acba-c5664665a40f tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Action: 'create', calling method: .version_select at 0x7f9baac955e0>, body: {"snapshot": {"volume_id": "5823da6a-ef1a-4a1a-a23c-167ef1a18d92", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-917807411"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:22.858529 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ef0c2200-6739-4f82-acba-c5664665a40f tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.169576 Sep 17 21:14:22.859373 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 483/996] 10.222.0.16 () {60 vars in 1162 bytes} [Sat Sep 17 21:14:22 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:22.870637 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-305d9826-ec5b-4f6d-930b-d63694f53b01 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9ba7435550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:22.904808 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-305d9826-ec5b-4f6d-930b-d63694f53b01 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b" status: 200 len: 286 microversion: 2.1 time: 0.038111 Sep 17 21:14:22.905365 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 514/997] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 17 21:14:22 2022] GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:22.916487 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-600e9072-c8c7-424c-b500-a24d50426b8c tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9baac95f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:22.950760 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-600e9072-c8c7-424c-b500-a24d50426b8c tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037805 Sep 17 21:14:22.951728 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 484/998] 10.222.0.16 () {58 vars in 1140 bytes} [Sat Sep 17 21:14:22 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:22.962748 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-91ccad54-8538-4bac-858e-7a1aa9dd4302 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9ba77fce50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:22.992922 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-91ccad54-8538-4bac-858e-7a1aa9dd4302 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b" status: 200 len: 286 microversion: 2.1 time: 0.033985 Sep 17 21:14:22.993486 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 515/999] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 17 21:14:22 2022] GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:24.005098 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-253d6cfe-8de1-4fe7-ac1d-390068742527 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9baacce700>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:24.041518 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-253d6cfe-8de1-4fe7-ac1d-390068742527 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b" status: 200 len: 286 microversion: 2.1 time: 0.039909 Sep 17 21:14:24.042341 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 485/1000] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 17 21:14:23 2022] GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:14:25.058566 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5db7bf6a-6552-4e8c-912b-07c7eda29ec1 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9ba73c6ee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:25.090261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5db7bf6a-6552-4e8c-912b-07c7eda29ec1 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b" status: 200 len: 286 microversion: 2.1 time: 0.035880 Sep 17 21:14:25.090942 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 516/1001] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 17 21:14:25 2022] GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:26.102500 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-feb6587b-e308-4015-a898-079fd2dab4e5 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9ba77f0310>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:26.133160 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-feb6587b-e308-4015-a898-079fd2dab4e5 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b" status: 200 len: 286 microversion: 2.1 time: 0.034860 Sep 17 21:14:26.133731 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 486/1002] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 17 21:14:26 2022] GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:27.146130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f2a6ca54-4e79-4bd8-9cc5-4a58bf9c2a05 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9ba77fce50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:27.176539 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f2a6ca54-4e79-4bd8-9cc5-4a58bf9c2a05 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b" status: 200 len: 286 microversion: 2.1 time: 0.034590 Sep 17 21:14:27.177073 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 517/1003] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 17 21:14:27 2022] GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:28.187228 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:28.187980 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:28.192392 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e0fef4ff-d53c-452f-b9ba-a7b766c6184d tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9baac95d30>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:28.223139 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e0fef4ff-d53c-452f-b9ba-a7b766c6184d tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b" status: 200 len: 287 microversion: 2.1 time: 0.037035 Sep 17 21:14:28.223706 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 487/1004] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 17 21:14:28 2022] GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:28.231677 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:28.232867 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=11 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:28.238061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-283f2db2-4a63-488b-8fad-c1baed5702b9 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9ba74a2310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:28.299272 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-283f2db2-4a63-488b-8fad-c1baed5702b9 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b" status: 202 len: 0 microversion: 2.1 time: 0.068136 Sep 17 21:14:28.299881 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 518/1005] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Sep 17 21:14:28 2022] DELETE /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:14:28.308088 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ee8058a3-3878-4985-9f30-d7cce0288769 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9baaca8040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:28.338523 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ee8058a3-3878-4985-9f30-d7cce0288769 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b" status: 200 len: 286 microversion: 2.1 time: 0.034182 Sep 17 21:14:28.339087 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 488/1006] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 17 21:14:28 2022] GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:29.351776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5611f9a-8ec5-48ec-83bd-38a41ec27bc9 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9ba74445e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:29.381427 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d5611f9a-8ec5-48ec-83bd-38a41ec27bc9 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] HTTP exception thrown: Snapshot 52140e1e-0f64-4f01-8ebf-966377a3359b could not be found. Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5611f9a-8ec5-48ec-83bd-38a41ec27bc9 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Request method failure captured: Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b HTTP/1.1 Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjisd20X9U2g8CxSXGdxl-31yDE3mUyVuPo1JRBAMQBaUdL8wQ5YriBMuUUFQISNCoMuH8RXerUBHBgljtHPd7B7UXqKfHkwvYhbSIhlz8djM4BX8NnmNvDexajkOlZa4SW2GifnW9iIEXIzqNusqT2B_wRAQVNRVzkA8SSlwGoo0P8 Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: da38f909cf414cbcaf6d41281cf5c971 Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941710901 Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:14:29.383617 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941710901 Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: da38f909cf414cbcaf6d41281cf5c971 Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941710901 Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesSnapshotsTestJSON-941710901-project Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 3de5399c4f79468aa6b01f2cb648679a Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941710901-project Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Snapshot 52140e1e-0f64-4f01-8ebf-966377a3359b could not be found. Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '52140e1e-0f64-4f01-8ebf-966377a3359b'} Sep 17 21:14:29.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 52140e1e-0f64-4f01-8ebf-966377a3359b could not be found. (HTTP 404) (Request-ID: req-25abad9c-2b50-47b6-a088-37f8a653f908) Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:29.386322 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:14:29.388148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 52140e1e-0f64-4f01-8ebf-966377a3359b could not be found. Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 17 21:14:29.389679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 52140e1e-0f64-4f01-8ebf-966377a3359b could not be found. Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 52140e1e-0f64-4f01-8ebf-966377a3359b could not be found. Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5611f9a-8ec5-48ec-83bd-38a41ec27bc9 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Returning 404 to user: Snapshot 52140e1e-0f64-4f01-8ebf-966377a3359b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:29.391146 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d5611f9a-8ec5-48ec-83bd-38a41ec27bc9 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b" status: 404 len: 111 microversion: 2.1 time: 0.037588 Sep 17 21:14:29.392107 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 519/1007] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 17 21:14:29 2022] GET /compute/v2.1/os-snapshots/52140e1e-0f64-4f01-8ebf-966377a3359b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:29.394034 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7828b58a-3420-4f47-93ec-f1ed211080e0 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9baacce940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:29.458273 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7828b58a-3420-4f47-93ec-f1ed211080e0 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92" status: 202 len: 0 microversion: 2.1 time: 0.067842 Sep 17 21:14:29.459201 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 489/1008] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 17 21:14:29 2022] DELETE /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:14:29.467530 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ea4eda5-37fe-4659-a375-1be969fecf7a tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9ba74a2550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:29.515859 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ea4eda5-37fe-4659-a375-1be969fecf7a tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92" status: 200 len: 345 microversion: 2.1 time: 0.052742 Sep 17 21:14:29.516408 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 520/1009] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:14:29 2022] GET /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:30.531781 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b1b3ad3f-3d97-4505-96d1-08073b748e57 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9baacce9d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:30.563709 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b1b3ad3f-3d97-4505-96d1-08073b748e57 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] HTTP exception thrown: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b1b3ad3f-3d97-4505-96d1-08073b748e57 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Request method failure captured: Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92 HTTP/1.1 Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjisd20X9U2g8CxSXGdxl-31yDE3mUyVuPo1JRBAMQBaUdL8wQ5YriBMuUUFQISNCoMuH8RXerUBHBgljtHPd7B7UXqKfHkwvYhbSIhlz8djM4BX8NnmNvDexajkOlZa4SW2GifnW9iIEXIzqNusqT2B_wRAQVNRVzkA8SSlwGoo0P8 Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: da38f909cf414cbcaf6d41281cf5c971 Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941710901 Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:14:30.566204 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941710901 Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: da38f909cf414cbcaf6d41281cf5c971 Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941710901 Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesSnapshotsTestJSON-941710901-project Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 3de5399c4f79468aa6b01f2cb648679a Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941710901-project Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '5823da6a-ef1a-4a1a-a23c-167ef1a18d92'} Sep 17 21:14:30.567580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. (HTTP 404) (Request-ID: req-4ca2af27-137d-4645-a835-21d19b0655aa) Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:30.568936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:14:30.570388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 17 21:14:30.571851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b1b3ad3f-3d97-4505-96d1-08073b748e57 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Returning 404 to user: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b1b3ad3f-3d97-4505-96d1-08073b748e57 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92" status: 404 len: 109 microversion: 2.1 time: 0.041446 Sep 17 21:14:30.573476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 490/1010] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:14:30 2022] GET /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:30.584235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-adc4167f-4069-4d3b-861e-4618d68fb8da tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9ba77fc280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:30.614919 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-adc4167f-4069-4d3b-861e-4618d68fb8da tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] HTTP exception thrown: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-adc4167f-4069-4d3b-861e-4618d68fb8da tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Request method failure captured: Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92 HTTP/1.1 Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjisd20X9U2g8CxSXGdxl-31yDE3mUyVuPo1JRBAMQBaUdL8wQ5YriBMuUUFQISNCoMuH8RXerUBHBgljtHPd7B7UXqKfHkwvYhbSIhlz8djM4BX8NnmNvDexajkOlZa4SW2GifnW9iIEXIzqNusqT2B_wRAQVNRVzkA8SSlwGoo0P8 Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: da38f909cf414cbcaf6d41281cf5c971 Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941710901 Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:14:30.616961 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941710901 Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: da38f909cf414cbcaf6d41281cf5c971 Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941710901 Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesSnapshotsTestJSON-941710901-project Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 3de5399c4f79468aa6b01f2cb648679a Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941710901-project Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '5823da6a-ef1a-4a1a-a23c-167ef1a18d92'} Sep 17 21:14:30.618375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. (HTTP 404) (Request-ID: req-11bc9def-0366-46c6-96f3-3c02ac17855f) Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:30.619292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 17 21:14:30.620542 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 17 21:14:30.621791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-adc4167f-4069-4d3b-861e-4618d68fb8da tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Returning 404 to user: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-adc4167f-4069-4d3b-861e-4618d68fb8da tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92" status: 404 len: 109 microversion: 2.1 time: 0.039068 Sep 17 21:14:30.623400 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 521/1011] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 17 21:14:30 2022] DELETE /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:30.628868 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b862f40-71ae-4c6b-9dcc-805c4e367242 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Calling method '.version_select at 0x7f9baad46b80>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:30.656511 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-0b862f40-71ae-4c6b-9dcc-805c4e367242 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] HTTP exception thrown: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b862f40-71ae-4c6b-9dcc-805c4e367242 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Request method failure captured: Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92 HTTP/1.1 Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjisd20X9U2g8CxSXGdxl-31yDE3mUyVuPo1JRBAMQBaUdL8wQ5YriBMuUUFQISNCoMuH8RXerUBHBgljtHPd7B7UXqKfHkwvYhbSIhlz8djM4BX8NnmNvDexajkOlZa4SW2GifnW9iIEXIzqNusqT2B_wRAQVNRVzkA8SSlwGoo0P8 Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: da38f909cf414cbcaf6d41281cf5c971 Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941710901 Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:14:30.658547 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da38f909cf414cbcaf6d41281cf5c971"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941710901 Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: da38f909cf414cbcaf6d41281cf5c971 Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941710901 Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesSnapshotsTestJSON-941710901-project Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 3de5399c4f79468aa6b01f2cb648679a Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941710901-project Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '5823da6a-ef1a-4a1a-a23c-167ef1a18d92'} Sep 17 21:14:30.659908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. (HTTP 404) (Request-ID: req-88b49645-6243-466b-b12d-737dadd185f6) Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:30.660793 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:14:30.661970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 17 21:14:30.663097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b862f40-71ae-4c6b-9dcc-805c4e367242 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] Returning 404 to user: Volume 5823da6a-ef1a-4a1a-a23c-167ef1a18d92 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0b862f40-71ae-4c6b-9dcc-805c4e367242 tempest-VolumesSnapshotsTestJSON-941710901 tempest-VolumesSnapshotsTestJSON-941710901-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92" status: 404 len: 109 microversion: 2.1 time: 0.036561 Sep 17 21:14:30.664203 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 491/1012] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 17 21:14:30 2022] GET /compute/v2.1/os-volumes/5823da6a-ef1a-4a1a-a23c-167ef1a18d92 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:15:20.715921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d505021-3243-4c23-be94-48a80b2b8ee0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:20.718328 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0d505021-3243-4c23-be94-48a80b2b8ee0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:20.729206 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d505021-3243-4c23-be94-48a80b2b8ee0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:20.730326 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d505021-3243-4c23-be94-48a80b2b8ee0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:20.730995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d505021-3243-4c23-be94-48a80b2b8ee0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:20.732599 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d505021-3243-4c23-be94-48a80b2b8ee0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:20.733249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d505021-3243-4c23-be94-48a80b2b8ee0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:20.733854 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d505021-3243-4c23-be94-48a80b2b8ee0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:20.771805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d505021-3243-4c23-be94-48a80b2b8ee0 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059888 Sep 17 21:15:20.773345 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 522/1013] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Sep 17 21:15:20 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:20.847388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5df7f2b5-340f-4805-8fe2-25a458d847e3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:20.847988 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5df7f2b5-340f-4805-8fe2-25a458d847e3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:20.859297 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5df7f2b5-340f-4805-8fe2-25a458d847e3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:20.859796 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5df7f2b5-340f-4805-8fe2-25a458d847e3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:20.860294 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5df7f2b5-340f-4805-8fe2-25a458d847e3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:20.861230 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5df7f2b5-340f-4805-8fe2-25a458d847e3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:20.861692 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5df7f2b5-340f-4805-8fe2-25a458d847e3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:20.862201 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5df7f2b5-340f-4805-8fe2-25a458d847e3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:20.896200 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5df7f2b5-340f-4805-8fe2-25a458d847e3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:15:21.030391 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5df7f2b5-340f-4805-8fe2-25a458d847e3 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 204 len: 0 microversion: 2.20 time: 0.186692 Sep 17 21:15:21.031591 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 492/1014] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 17 21:15:20 2022] DELETE /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:15:21.044427 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b896383f-c7f6-405f-a0c7-fc94a60752f8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:21.045175 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b896383f-c7f6-405f-a0c7-fc94a60752f8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:21.055333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b896383f-c7f6-405f-a0c7-fc94a60752f8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:21.058171 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b896383f-c7f6-405f-a0c7-fc94a60752f8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:21.059314 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b896383f-c7f6-405f-a0c7-fc94a60752f8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:21.061417 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b896383f-c7f6-405f-a0c7-fc94a60752f8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:21.064388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b896383f-c7f6-405f-a0c7-fc94a60752f8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:21.065149 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b896383f-c7f6-405f-a0c7-fc94a60752f8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:21.224093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b896383f-c7f6-405f-a0c7-fc94a60752f8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:21.233374 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b896383f-c7f6-405f-a0c7-fc94a60752f8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:21.235335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b896383f-c7f6-405f-a0c7-fc94a60752f8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:21.236560 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b896383f-c7f6-405f-a0c7-fc94a60752f8 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.200394 Sep 17 21:15:21.237410 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 523/1015] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:21 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:15:22.268476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-44d992b4-5fae-491a-9475-c7d6843b9c91 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:22.269983 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-44d992b4-5fae-491a-9475-c7d6843b9c91 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:22.276970 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44d992b4-5fae-491a-9475-c7d6843b9c91 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:22.277585 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44d992b4-5fae-491a-9475-c7d6843b9c91 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:22.278119 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44d992b4-5fae-491a-9475-c7d6843b9c91 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:22.281615 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44d992b4-5fae-491a-9475-c7d6843b9c91 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:22.282235 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44d992b4-5fae-491a-9475-c7d6843b9c91 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:22.285211 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44d992b4-5fae-491a-9475-c7d6843b9c91 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:22.461215 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-44d992b4-5fae-491a-9475-c7d6843b9c91 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:22.471689 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-44d992b4-5fae-491a-9475-c7d6843b9c91 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:22.473451 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-44d992b4-5fae-491a-9475-c7d6843b9c91 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:22.474986 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-44d992b4-5fae-491a-9475-c7d6843b9c91 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.213543 Sep 17 21:15:22.476048 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 493/1016] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:22 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:23.506829 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1af5dd4a-e0d6-4448-92fb-7d7db98377b4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:23.507445 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1af5dd4a-e0d6-4448-92fb-7d7db98377b4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:23.518890 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1af5dd4a-e0d6-4448-92fb-7d7db98377b4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:23.519386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1af5dd4a-e0d6-4448-92fb-7d7db98377b4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:23.519825 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1af5dd4a-e0d6-4448-92fb-7d7db98377b4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:23.520544 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1af5dd4a-e0d6-4448-92fb-7d7db98377b4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:23.521027 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1af5dd4a-e0d6-4448-92fb-7d7db98377b4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:23.521454 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1af5dd4a-e0d6-4448-92fb-7d7db98377b4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:23.700559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1af5dd4a-e0d6-4448-92fb-7d7db98377b4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:23.710621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1af5dd4a-e0d6-4448-92fb-7d7db98377b4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:23.713341 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1af5dd4a-e0d6-4448-92fb-7d7db98377b4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:23.714642 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1af5dd4a-e0d6-4448-92fb-7d7db98377b4 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1721 microversion: 2.20 time: 0.211860 Sep 17 21:15:23.715360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 524/1017] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:23 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:24.741707 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3b28f28-5e51-4c4f-ab97-f09d9aa219b7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:24.742965 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3b28f28-5e51-4c4f-ab97-f09d9aa219b7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:24.755795 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3b28f28-5e51-4c4f-ab97-f09d9aa219b7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:24.759093 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3b28f28-5e51-4c4f-ab97-f09d9aa219b7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:24.762089 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3b28f28-5e51-4c4f-ab97-f09d9aa219b7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:24.763060 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3b28f28-5e51-4c4f-ab97-f09d9aa219b7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:24.766167 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3b28f28-5e51-4c4f-ab97-f09d9aa219b7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:24.766607 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3b28f28-5e51-4c4f-ab97-f09d9aa219b7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:24.841510 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-4ca5a3f1-87a7-44f7-82c6-97e18fa4456b req-02c0c056-a994-4003-ae68-c9cfa1f25171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a67b77-200a-44df-918e-757ee2cae914", "name": "network-vif-deleted", "tag": "26d391cd-62d3-4e74-b7fe-db22e47cae57"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:24.864779 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4ca5a3f1-87a7-44f7-82c6-97e18fa4456b req-02c0c056-a994-4003-ae68-c9cfa1f25171 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:24.865579 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4ca5a3f1-87a7-44f7-82c6-97e18fa4456b req-02c0c056-a994-4003-ae68-c9cfa1f25171 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:24.866191 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4ca5a3f1-87a7-44f7-82c6-97e18fa4456b req-02c0c056-a994-4003-ae68-c9cfa1f25171 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:24.888649 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-4ca5a3f1-87a7-44f7-82c6-97e18fa4456b req-02c0c056-a994-4003-ae68-c9cfa1f25171 service nova] Creating event network-vif-deleted:26d391cd-62d3-4e74-b7fe-db22e47cae57 for instance 60a67b77-200a-44df-918e-757ee2cae914 on hv-cinder-82651 Sep 17 21:15:24.902561 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-4ca5a3f1-87a7-44f7-82c6-97e18fa4456b req-02c0c056-a994-4003-ae68-c9cfa1f25171 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072382 Sep 17 21:15:24.904017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 525/1018] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:15:25.030048 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3b28f28-5e51-4c4f-ab97-f09d9aa219b7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:25.052743 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3b28f28-5e51-4c4f-ab97-f09d9aa219b7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:25.059019 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3b28f28-5e51-4c4f-ab97-f09d9aa219b7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc5f1d34cad437ea15efb98a0a1ca31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1913d0c899c48ab9a7781a9e45ac4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:25.060233 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3b28f28-5e51-4c4f-ab97-f09d9aa219b7 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 200 len: 1653 microversion: 2.20 time: 0.322434 Sep 17 21:15:25.070533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 494/1019] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:24 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 1653 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:26.102090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-48031aad-a28b-4122-a7d3-12ffcdff1904 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:26.102787 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-48031aad-a28b-4122-a7d3-12ffcdff1904 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:26.116297 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48031aad-a28b-4122-a7d3-12ffcdff1904 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:26.116806 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48031aad-a28b-4122-a7d3-12ffcdff1904 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:26.121034 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48031aad-a28b-4122-a7d3-12ffcdff1904 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:26.121990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48031aad-a28b-4122-a7d3-12ffcdff1904 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:26.123805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48031aad-a28b-4122-a7d3-12ffcdff1904 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:26.125595 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48031aad-a28b-4122-a7d3-12ffcdff1904 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:26.143597 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-48031aad-a28b-4122-a7d3-12ffcdff1904 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] HTTP exception thrown: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-48031aad-a28b-4122-a7d3-12ffcdff1904 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Request method failure captured: Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 HTTP/1.1 Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjbY67QsthoGPVIH5wsZ6UE0ZXF4vAngHarTJHG7zuiWMkZFzNUvN_h0xHOnc1ker2zx9T9-SdtTIX-wUg6zFdFEoZ3aHhieg0qiMeqFB7CqQ9CN7VnWFlyNZBXZX8THngcZ5BK2D7cFCDIQOqkgYu7cBZ89ZETAbDxSdfMeZW4bZVU Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.20 Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: c1913d0c899c48ab9a7781a9e45ac4a9 Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:15:26.145593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:15:26.147298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:15:26.147298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:26.147298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: c1913d0c899c48ab9a7781a9e45ac4a9 Sep 17 21:15:26.147298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:26.147298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeShelveTestJSON-1358903316-project Sep 17 21:15:26.147298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:15:26.147298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:15:26.147298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 1dc5f1d34cad437ea15efb98a0a1ca31 Sep 17 21:15:26.147298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1358903316-project Sep 17 21:15:26.147298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:15:26.147298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:26.147298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '60a67b77-200a-44df-918e-757ee2cae914'} Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:15:26.148109 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:26.149471 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:26.152007 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-48031aad-a28b-4122-a7d3-12ffcdff1904 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Returning 404 to user: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:15:26.153103 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-48031aad-a28b-4122-a7d3-12ffcdff1904 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 404 len: 111 microversion: 2.20 time: 0.055341 Sep 17 21:15:26.154428 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 526/1020] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:26 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:15:26.164224 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df37b89c-dacb-41e5-9ce9-55bb3882ed8a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '.version_select at 0x7f9baac5b4c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:26.196416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df37b89c-dacb-41e5-9ce9-55bb3882ed8a tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-505406497" status: 204 len: 0 microversion: 2.20 time: 0.036623 Sep 17 21:15:26.197064 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 495/1021] 10.222.0.16 () {60 vars in 1259 bytes} [Sat Sep 17 21:15:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-505406497 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:15:28.417789 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc8698e0-aa99-49a1-b542-982165e1f4ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:28.418390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc8698e0-aa99-49a1-b542-982165e1f4ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:28.425193 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc8698e0-aa99-49a1-b542-982165e1f4ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:28.426019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc8698e0-aa99-49a1-b542-982165e1f4ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:28.426641 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc8698e0-aa99-49a1-b542-982165e1f4ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:28.427361 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc8698e0-aa99-49a1-b542-982165e1f4ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:28.427853 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc8698e0-aa99-49a1-b542-982165e1f4ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:28.428280 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc8698e0-aa99-49a1-b542-982165e1f4ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:28.445418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-bc8698e0-aa99-49a1-b542-982165e1f4ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] HTTP exception thrown: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc8698e0-aa99-49a1-b542-982165e1f4ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Request method failure captured: Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 HTTP/1.1 Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjbY67QsthoGPVIH5wsZ6UE0ZXF4vAngHarTJHG7zuiWMkZFzNUvN_h0xHOnc1ker2zx9T9-SdtTIX-wUg6zFdFEoZ3aHhieg0qiMeqFB7CqQ9CN7VnWFlyNZBXZX8THngcZ5BK2D7cFCDIQOqkgYu7cBZ89ZETAbDxSdfMeZW4bZVU Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.20 Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: c1913d0c899c48ab9a7781a9e45ac4a9 Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:15:28.447399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:15:28.449217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:15:28.449217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:28.449217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: c1913d0c899c48ab9a7781a9e45ac4a9 Sep 17 21:15:28.449217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:28.449217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeShelveTestJSON-1358903316-project Sep 17 21:15:28.449217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:15:28.449217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:15:28.449217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 1dc5f1d34cad437ea15efb98a0a1ca31 Sep 17 21:15:28.449217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1358903316-project Sep 17 21:15:28.449217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:15:28.449217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:28.449217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '60a67b77-200a-44df-918e-757ee2cae914'} Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:15:28.450037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:28.451290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:28.454729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc8698e0-aa99-49a1-b542-982165e1f4ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Returning 404 to user: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:15:28.455855 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc8698e0-aa99-49a1-b542-982165e1f4ee tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 404 len: 111 microversion: 2.20 time: 0.043345 Sep 17 21:15:28.456936 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 527/1022] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 17 21:15:28 2022] DELETE /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:15:28.464803 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c040e369-8b47-4644-806f-20c960c5e9db tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:28.466076 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c040e369-8b47-4644-806f-20c960c5e9db tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 60a67b77-200a-44df-918e-757ee2cae914] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:28.473667 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c040e369-8b47-4644-806f-20c960c5e9db tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:28.475064 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c040e369-8b47-4644-806f-20c960c5e9db tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:28.475620 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c040e369-8b47-4644-806f-20c960c5e9db tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:28.476432 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c040e369-8b47-4644-806f-20c960c5e9db tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:28.477032 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c040e369-8b47-4644-806f-20c960c5e9db tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:28.477679 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c040e369-8b47-4644-806f-20c960c5e9db tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:28.493099 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c040e369-8b47-4644-806f-20c960c5e9db tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] HTTP exception thrown: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c040e369-8b47-4644-806f-20c960c5e9db tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Request method failure captured: Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 HTTP/1.1 Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjbY67QsthoGPVIH5wsZ6UE0ZXF4vAngHarTJHG7zuiWMkZFzNUvN_h0xHOnc1ker2zx9T9-SdtTIX-wUg6zFdFEoZ3aHhieg0qiMeqFB7CqQ9CN7VnWFlyNZBXZX8THngcZ5BK2D7cFCDIQOqkgYu7cBZ89ZETAbDxSdfMeZW4bZVU Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: c1913d0c899c48ab9a7781a9e45ac4a9 Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:15:28.495261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:15:28.496844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:15:28.496844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:28.496844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: c1913d0c899c48ab9a7781a9e45ac4a9 Sep 17 21:15:28.496844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:28.496844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1358903316-project Sep 17 21:15:28.496844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:15:28.496844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:15:28.496844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1dc5f1d34cad437ea15efb98a0a1ca31 Sep 17 21:15:28.496844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1358903316-project Sep 17 21:15:28.496844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:15:28.496844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:28.496844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '60a67b77-200a-44df-918e-757ee2cae914'} Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:15:28.497878 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. Sep 17 21:15:28.500127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:15:28.502108 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c040e369-8b47-4644-806f-20c960c5e9db tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Returning 404 to user: Instance 60a67b77-200a-44df-918e-757ee2cae914 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:15:28.502108 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c040e369-8b47-4644-806f-20c960c5e9db tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914" status: 404 len: 111 microversion: 2.20 time: 0.035803 Sep 17 21:15:28.502108 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 496/1023] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:28 2022] GET /compute/v2.1/servers/60a67b77-200a-44df-918e-757ee2cae914 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:15:29.706201 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86933f36-45f1-4198-8560-965674148f04 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:29.706714 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-86933f36-45f1-4198-8560-965674148f04 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:29.717305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86933f36-45f1-4198-8560-965674148f04 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:29.717792 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86933f36-45f1-4198-8560-965674148f04 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:29.718851 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86933f36-45f1-4198-8560-965674148f04 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:29.719684 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86933f36-45f1-4198-8560-965674148f04 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:29.720149 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86933f36-45f1-4198-8560-965674148f04 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:29.720573 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86933f36-45f1-4198-8560-965674148f04 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:29.746846 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-86933f36-45f1-4198-8560-965674148f04 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] HTTP exception thrown: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86933f36-45f1-4198-8560-965674148f04 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Request method failure captured: Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 HTTP/1.1 Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjbY67QsthoGPVIH5wsZ6UE0ZXF4vAngHarTJHG7zuiWMkZFzNUvN_h0xHOnc1ker2zx9T9-SdtTIX-wUg6zFdFEoZ3aHhieg0qiMeqFB7CqQ9CN7VnWFlyNZBXZX8THngcZ5BK2D7cFCDIQOqkgYu7cBZ89ZETAbDxSdfMeZW4bZVU Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.20 Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: c1913d0c899c48ab9a7781a9e45ac4a9 Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:15:29.748386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:15:29.750083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:15:29.750083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:29.750083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: c1913d0c899c48ab9a7781a9e45ac4a9 Sep 17 21:15:29.750083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:29.750083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-AttachVolumeShelveTestJSON-1358903316-project Sep 17 21:15:29.750083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:15:29.750083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:15:29.750083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 1dc5f1d34cad437ea15efb98a0a1ca31 Sep 17 21:15:29.750083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1358903316-project Sep 17 21:15:29.750083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:15:29.750083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:15:29.750083 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '785212fb-7493-49ce-b3f0-12b3742b3a88'} Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:15:29.751101 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:15:29.752645 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:15:29.754801 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86933f36-45f1-4198-8560-965674148f04 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Returning 404 to user: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:15:29.755842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-86933f36-45f1-4198-8560-965674148f04 tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "DELETE /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 404 len: 111 microversion: 2.20 time: 0.053953 Sep 17 21:15:29.761554 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 528/1024] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 17 21:15:29 2022] DELETE /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:15:29.771132 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d090c06-14b3-437e-bfe1-c43bc388991c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:29.771758 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d090c06-14b3-437e-bfe1-c43bc388991c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] [instance: 785212fb-7493-49ce-b3f0-12b3742b3a88] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:29.778255 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d090c06-14b3-437e-bfe1-c43bc388991c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:29.778741 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d090c06-14b3-437e-bfe1-c43bc388991c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:29.779170 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d090c06-14b3-437e-bfe1-c43bc388991c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:29.779863 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d090c06-14b3-437e-bfe1-c43bc388991c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:29.780308 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d090c06-14b3-437e-bfe1-c43bc388991c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:29.780826 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d090c06-14b3-437e-bfe1-c43bc388991c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:29.799140 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-0d090c06-14b3-437e-bfe1-c43bc388991c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] HTTP exception thrown: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d090c06-14b3-437e-bfe1-c43bc388991c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Request method failure captured: Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 HTTP/1.1 Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjbY67QsthoGPVIH5wsZ6UE0ZXF4vAngHarTJHG7zuiWMkZFzNUvN_h0xHOnc1ker2zx9T9-SdtTIX-wUg6zFdFEoZ3aHhieg0qiMeqFB7CqQ9CN7VnWFlyNZBXZX8THngcZ5BK2D7cFCDIQOqkgYu7cBZ89ZETAbDxSdfMeZW4bZVU Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: c1913d0c899c48ab9a7781a9e45ac4a9 Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:15:29.802028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:15:29.803732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1913d0c899c48ab9a7781a9e45ac4a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:15:29.803732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:29.803732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: c1913d0c899c48ab9a7781a9e45ac4a9 Sep 17 21:15:29.803732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1358903316 Sep 17 21:15:29.803732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1358903316-project Sep 17 21:15:29.803732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:15:29.803732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:15:29.803732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 1dc5f1d34cad437ea15efb98a0a1ca31 Sep 17 21:15:29.803732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1358903316-project Sep 17 21:15:29.803732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:15:29.803732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:15:29.803732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '785212fb-7493-49ce-b3f0-12b3742b3a88'} Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:15:29.804624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. Sep 17 21:15:29.806075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:15:29.808261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d090c06-14b3-437e-bfe1-c43bc388991c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] Returning 404 to user: Instance 785212fb-7493-49ce-b3f0-12b3742b3a88 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:15:29.809392 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d090c06-14b3-437e-bfe1-c43bc388991c tempest-AttachVolumeShelveTestJSON-1358903316 tempest-AttachVolumeShelveTestJSON-1358903316-project] 10.222.0.16 "GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88" status: 404 len: 111 microversion: 2.20 time: 0.048307 Sep 17 21:15:29.814437 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 497/1025] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:29 2022] GET /compute/v2.1/servers/785212fb-7493-49ce-b3f0-12b3742b3a88 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:15:32.530236 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-57c21c83-e7e9-4a74-b7b8-a4e3c9a91612 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Action: 'create', calling method: .version_select at 0x7f9ba74a2a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2020521357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+vWw5fynce/SAwYmyuOdaA7B6ThOBDEh4VX+Ywel8xsPZIl4xzacUee72rNkj1/z/Rmk9rcZppObNrKzZ7BOg1ZPhp6LVfI+nJNTCetknApAlMTt7JjCkutsRpUiM0eg=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:32.548292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-57c21c83-e7e9-4a74-b7b8-a4e3c9a91612 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Getting quotas for project 84fb17d896e344aa8c871bf741305304. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:15:32.552995 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-57c21c83-e7e9-4a74-b7b8-a4e3c9a91612 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Getting quotas for user d4d5d6a240fc4dfba9bc0ced8db6d1e8 and project 84fb17d896e344aa8c871bf741305304. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:15:32.580651 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-57c21c83-e7e9-4a74-b7b8-a4e3c9a91612 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054879 Sep 17 21:15:32.581546 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 529/1026] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 17 21:15:32 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:15:32.636841 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1564396442", "imageRef": "23379a94-55bf-43af-aae0-c89d18baa123", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2020521357", "networks": [{"uuid": "3c718135-7edf-4e6f-a4f9-1c37fb6996d2"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:32.691463 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] validate_networks() for [('3c718135-7edf-4e6f-a4f9-1c37fb6996d2', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:15:33.111409 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:15:33.111956 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:15:33.112571 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:15:33.113107 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:15:33.113614 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:15:33.123935 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:33.124639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:33.125672 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:33.126256 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:33.126959 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:33.127721 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:33.150443 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Getting quotas for project 84fb17d896e344aa8c871bf741305304. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:15:33.155301 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Getting quotas for user d4d5d6a240fc4dfba9bc0ced8db6d1e8 and project 84fb17d896e344aa8c871bf741305304. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:15:33.168987 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:15:33.171303 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23379a94-55bf-43af-aae0-c89d18baa123',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:15:33.223209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec828a28-89ea-4958-bf13-a06ab8ce9078 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590732 Sep 17 21:15:33.224030 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 498/1027] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:15:33.235457 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-42e9e630-d48a-4b2e-a543-56c550aa0c4a tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:33.236197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-42e9e630-d48a-4b2e-a543-56c550aa0c4a tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:33.303886 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-42e9e630-d48a-4b2e-a543-56c550aa0c4a tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:33.310852 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-42e9e630-d48a-4b2e-a543-56c550aa0c4a tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1259 microversion: 2.1 time: 0.079789 Sep 17 21:15:33.311404 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 530/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:33 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1259 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:15:34.339038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0250bed9-74d7-4b8e-b092-95595582fecf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:34.339787 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0250bed9-74d7-4b8e-b092-95595582fecf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:34.398149 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0250bed9-74d7-4b8e-b092-95595582fecf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:34.407196 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0250bed9-74d7-4b8e-b092-95595582fecf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1259 microversion: 2.1 time: 0.072379 Sep 17 21:15:34.408005 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 499/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:34 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:35.430474 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f1e238c-9ae8-4d5b-9c08-e9b650749dab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:35.431087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1f1e238c-9ae8-4d5b-9c08-e9b650749dab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:35.487328 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f1e238c-9ae8-4d5b-9c08-e9b650749dab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:35.494329 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f1e238c-9ae8-4d5b-9c08-e9b650749dab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1259 microversion: 2.1 time: 0.067683 Sep 17 21:15:35.494886 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 531/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:35 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:36.518306 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3af5970-8e66-48b9-bf01-3349c96040bc tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:36.518922 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f3af5970-8e66-48b9-bf01-3349c96040bc tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:36.570949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f3af5970-8e66-48b9-bf01-3349c96040bc tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:36.578285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f3af5970-8e66-48b9-bf01-3349c96040bc tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1259 microversion: 2.1 time: 0.064075 Sep 17 21:15:36.578831 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 500/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:36 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:37.606749 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-befafe43-a10e-4b85-8f6a-afe142106f1e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:37.607350 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-befafe43-a10e-4b85-8f6a-afe142106f1e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:37.614838 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befafe43-a10e-4b85-8f6a-afe142106f1e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:37.615315 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befafe43-a10e-4b85-8f6a-afe142106f1e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:37.615746 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befafe43-a10e-4b85-8f6a-afe142106f1e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:37.616426 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befafe43-a10e-4b85-8f6a-afe142106f1e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:37.616904 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befafe43-a10e-4b85-8f6a-afe142106f1e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:37.617328 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befafe43-a10e-4b85-8f6a-afe142106f1e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:37.675782 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-befafe43-a10e-4b85-8f6a-afe142106f1e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:37.683311 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-befafe43-a10e-4b85-8f6a-afe142106f1e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1263 microversion: 2.1 time: 0.080389 Sep 17 21:15:37.683870 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 532/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:37 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1263 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:38.713015 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f62bff24-f2a8-4061-8087-be88da800603 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:38.714283 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f62bff24-f2a8-4061-8087-be88da800603 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:38.721994 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f62bff24-f2a8-4061-8087-be88da800603 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:38.722711 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f62bff24-f2a8-4061-8087-be88da800603 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:38.723207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f62bff24-f2a8-4061-8087-be88da800603 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:38.724345 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f62bff24-f2a8-4061-8087-be88da800603 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:38.724919 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f62bff24-f2a8-4061-8087-be88da800603 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:38.725419 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f62bff24-f2a8-4061-8087-be88da800603 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:38.811628 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f62bff24-f2a8-4061-8087-be88da800603 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:38.821678 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f62bff24-f2a8-4061-8087-be88da800603 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1317 microversion: 2.1 time: 0.118447 Sep 17 21:15:38.822630 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 501/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:38 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1317 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:39.847162 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3682d24d-8a34-45fb-957f-b7ec43c43fb2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:39.848556 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3682d24d-8a34-45fb-957f-b7ec43c43fb2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:39.855661 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3682d24d-8a34-45fb-957f-b7ec43c43fb2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:39.856527 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3682d24d-8a34-45fb-957f-b7ec43c43fb2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:39.857228 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3682d24d-8a34-45fb-957f-b7ec43c43fb2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:39.858165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3682d24d-8a34-45fb-957f-b7ec43c43fb2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:39.859592 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3682d24d-8a34-45fb-957f-b7ec43c43fb2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:39.860327 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3682d24d-8a34-45fb-957f-b7ec43c43fb2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:39.988002 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-3682d24d-8a34-45fb-957f-b7ec43c43fb2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:39.996170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3682d24d-8a34-45fb-957f-b7ec43c43fb2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.153746 Sep 17 21:15:40.002469 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 533/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:39 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:41.019394 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3a56b9ee-3003-4163-9d03-93b2e11809a3 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:41.020287 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3a56b9ee-3003-4163-9d03-93b2e11809a3 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:41.026521 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a56b9ee-3003-4163-9d03-93b2e11809a3 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:41.027006 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a56b9ee-3003-4163-9d03-93b2e11809a3 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:41.027439 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a56b9ee-3003-4163-9d03-93b2e11809a3 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:41.028170 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a56b9ee-3003-4163-9d03-93b2e11809a3 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:41.028624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a56b9ee-3003-4163-9d03-93b2e11809a3 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:41.029070 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a56b9ee-3003-4163-9d03-93b2e11809a3 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:41.189327 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3a56b9ee-3003-4163-9d03-93b2e11809a3 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:41.196831 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3a56b9ee-3003-4163-9d03-93b2e11809a3 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.181301 Sep 17 21:15:41.197397 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 502/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:41 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:42.219358 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10fba58a-3f29-49fc-b24d-60cc608d6d1c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:42.220005 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-10fba58a-3f29-49fc-b24d-60cc608d6d1c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:42.227151 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10fba58a-3f29-49fc-b24d-60cc608d6d1c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:42.227672 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10fba58a-3f29-49fc-b24d-60cc608d6d1c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:42.228131 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10fba58a-3f29-49fc-b24d-60cc608d6d1c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:42.228907 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10fba58a-3f29-49fc-b24d-60cc608d6d1c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:42.229361 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10fba58a-3f29-49fc-b24d-60cc608d6d1c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:42.229800 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10fba58a-3f29-49fc-b24d-60cc608d6d1c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:42.389077 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-10fba58a-3f29-49fc-b24d-60cc608d6d1c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:42.398744 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-10fba58a-3f29-49fc-b24d-60cc608d6d1c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.183228 Sep 17 21:15:42.399321 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 534/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:42 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:43.422155 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7f8d74c-1f03-4d3e-a482-5088d869fc22 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:43.422765 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7f8d74c-1f03-4d3e-a482-5088d869fc22 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:43.425170 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:43.430548 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f8d74c-1f03-4d3e-a482-5088d869fc22 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:43.431025 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f8d74c-1f03-4d3e-a482-5088d869fc22 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:43.431452 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f8d74c-1f03-4d3e-a482-5088d869fc22 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:43.432135 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f8d74c-1f03-4d3e-a482-5088d869fc22 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:43.432582 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f8d74c-1f03-4d3e-a482-5088d869fc22 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:43.433025 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f8d74c-1f03-4d3e-a482-5088d869fc22 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:43.588837 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7f8d74c-1f03-4d3e-a482-5088d869fc22 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:43.597707 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7f8d74c-1f03-4d3e-a482-5088d869fc22 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.179227 Sep 17 21:15:43.613570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 503/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:43 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:44.627063 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fcf60804-b6c3-4075-ad45-4f54146446bd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:44.628309 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fcf60804-b6c3-4075-ad45-4f54146446bd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:44.636818 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf60804-b6c3-4075-ad45-4f54146446bd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:44.638592 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf60804-b6c3-4075-ad45-4f54146446bd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:44.639488 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf60804-b6c3-4075-ad45-4f54146446bd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:44.644770 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf60804-b6c3-4075-ad45-4f54146446bd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:44.645466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf60804-b6c3-4075-ad45-4f54146446bd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:44.646086 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf60804-b6c3-4075-ad45-4f54146446bd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:44.811664 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fcf60804-b6c3-4075-ad45-4f54146446bd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:44.820920 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fcf60804-b6c3-4075-ad45-4f54146446bd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.197459 Sep 17 21:15:44.821422 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 535/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:44 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:15:45.845526 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9a3ea74-4ac4-4eb4-8d42-e69452c2104e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:45.846278 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e9a3ea74-4ac4-4eb4-8d42-e69452c2104e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:45.859655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9a3ea74-4ac4-4eb4-8d42-e69452c2104e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:45.861556 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9a3ea74-4ac4-4eb4-8d42-e69452c2104e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:45.862076 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9a3ea74-4ac4-4eb4-8d42-e69452c2104e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:45.862835 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9a3ea74-4ac4-4eb4-8d42-e69452c2104e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:45.863365 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9a3ea74-4ac4-4eb4-8d42-e69452c2104e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:45.864019 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9a3ea74-4ac4-4eb4-8d42-e69452c2104e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:46.087148 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e9a3ea74-4ac4-4eb4-8d42-e69452c2104e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:46.106105 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e9a3ea74-4ac4-4eb4-8d42-e69452c2104e tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.266267 Sep 17 21:15:46.107559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 504/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:45 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:47.133164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7778f67-3570-4737-a7b8-3248abd12f88 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:47.134081 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f7778f67-3570-4737-a7b8-3248abd12f88 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:47.136555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:47.157207 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7778f67-3570-4737-a7b8-3248abd12f88 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:47.162176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7778f67-3570-4737-a7b8-3248abd12f88 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:47.162619 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7778f67-3570-4737-a7b8-3248abd12f88 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:47.163987 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7778f67-3570-4737-a7b8-3248abd12f88 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:47.165099 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7778f67-3570-4737-a7b8-3248abd12f88 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:47.165464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7778f67-3570-4737-a7b8-3248abd12f88 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:47.430260 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f7778f67-3570-4737-a7b8-3248abd12f88 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:47.440089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f7778f67-3570-4737-a7b8-3248abd12f88 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.313143 Sep 17 21:15:47.440856 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 536/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:47 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:48.463151 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:48.469525 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71de3c1d-8067-40dd-b645-65b0e33dc392 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:48.470074 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-71de3c1d-8067-40dd-b645-65b0e33dc392 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:48.482934 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71de3c1d-8067-40dd-b645-65b0e33dc392 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:48.483235 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71de3c1d-8067-40dd-b645-65b0e33dc392 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:48.483681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71de3c1d-8067-40dd-b645-65b0e33dc392 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:48.485073 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71de3c1d-8067-40dd-b645-65b0e33dc392 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:48.486748 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71de3c1d-8067-40dd-b645-65b0e33dc392 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:48.487196 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71de3c1d-8067-40dd-b645-65b0e33dc392 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:48.659896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-71de3c1d-8067-40dd-b645-65b0e33dc392 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:48.668866 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71de3c1d-8067-40dd-b645-65b0e33dc392 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.206449 Sep 17 21:15:48.670020 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 505/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:48 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:49.695250 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87e83bd9-7450-4cb2-bbe2-1becdd404567 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:49.695926 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-87e83bd9-7450-4cb2-bbe2-1becdd404567 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:49.702695 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87e83bd9-7450-4cb2-bbe2-1becdd404567 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:49.703518 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87e83bd9-7450-4cb2-bbe2-1becdd404567 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:49.703957 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87e83bd9-7450-4cb2-bbe2-1becdd404567 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:49.704655 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87e83bd9-7450-4cb2-bbe2-1becdd404567 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:49.705188 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87e83bd9-7450-4cb2-bbe2-1becdd404567 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:49.705534 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87e83bd9-7450-4cb2-bbe2-1becdd404567 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:49.840839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-87e83bd9-7450-4cb2-bbe2-1becdd404567 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:49.849555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-87e83bd9-7450-4cb2-bbe2-1becdd404567 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.158315 Sep 17 21:15:49.851038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 537/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:49 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:50.221790 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1841077546", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "networks": [{"uuid": "a94e86be-a0c6-4a92-8000-9151a5a0be32"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:50.287380 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] validate_networks() for [('a94e86be-a0c6-4a92-8000-9151a5a0be32', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:15:50.873596 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71a81c00-238e-4bd6-be1e-52dd02ead67d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:50.874209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-71a81c00-238e-4bd6-be1e-52dd02ead67d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:50.877148 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:50.887184 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71a81c00-238e-4bd6-be1e-52dd02ead67d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:50.887678 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71a81c00-238e-4bd6-be1e-52dd02ead67d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:50.888118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71a81c00-238e-4bd6-be1e-52dd02ead67d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:50.888868 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71a81c00-238e-4bd6-be1e-52dd02ead67d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:50.889325 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71a81c00-238e-4bd6-be1e-52dd02ead67d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:50.889744 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71a81c00-238e-4bd6-be1e-52dd02ead67d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:50.896992 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=63 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:50.906468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:15:50.907177 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:15:50.907931 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:15:50.908281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:15:50.908792 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:15:50.917528 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:50.930684 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:50.932175 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:50.937725 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:50.939068 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:50.940749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:50.941431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:50.949396 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:50.964160 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Getting quotas for project b48e7f3a322e47f9aa6224dac6a9e454. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:15:50.968939 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Getting quotas for user 94bd6c08de8743cd989ed3f88ed2aa9f and project b48e7f3a322e47f9aa6224dac6a9e454. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:15:50.982063 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:15:50.985136 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:15:51.034081 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd561474-20c3-497f-8911-048b8e23e6df tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816790 Sep 17 21:15:51.035054 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 506/1043] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:15:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:15:51.047611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c8a1681-54d4-42a8-959c-ba71d2ac5f4d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:51.048314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c8a1681-54d4-42a8-959c-ba71d2ac5f4d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:51.149200 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8c8a1681-54d4-42a8-959c-ba71d2ac5f4d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:51.151877 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-71a81c00-238e-4bd6-be1e-52dd02ead67d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:51.163968 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-71a81c00-238e-4bd6-be1e-52dd02ead67d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.294107 Sep 17 21:15:51.164694 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8c8a1681-54d4-42a8-959c-ba71d2ac5f4d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1219 microversion: 2.1 time: 0.122587 Sep 17 21:15:51.165791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 538/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:50 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:51.191645 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 507/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:51 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:51.541711 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5404a996-20ca-41ce-889a-a9887f2b1d75 req-e0ee6f48-252a-4a0c-8630-2754b10610f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb470a89-d7ed-49bd-b7d0-1141d8410aeb", "tag": "1cb82103-f71c-4280-8b52-006d0dc82f48"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:51.552111 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5404a996-20ca-41ce-889a-a9887f2b1d75 req-e0ee6f48-252a-4a0c-8630-2754b10610f1 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:51.552596 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5404a996-20ca-41ce-889a-a9887f2b1d75 req-e0ee6f48-252a-4a0c-8630-2754b10610f1 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:51.553054 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5404a996-20ca-41ce-889a-a9887f2b1d75 req-e0ee6f48-252a-4a0c-8630-2754b10610f1 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:51.566016 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5404a996-20ca-41ce-889a-a9887f2b1d75 req-e0ee6f48-252a-4a0c-8630-2754b10610f1 service nova] Creating event network-changed:1cb82103-f71c-4280-8b52-006d0dc82f48 for instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb on hv-cinder-82651 Sep 17 21:15:51.571234 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5404a996-20ca-41ce-889a-a9887f2b1d75 req-e0ee6f48-252a-4a0c-8630-2754b10610f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217445 Sep 17 21:15:51.572245 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 539/1046] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:15:52.190178 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e849aee-d3d1-42d0-bf7e-c1996b2abc35 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:52.190827 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e849aee-d3d1-42d0-bf7e-c1996b2abc35 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:52.197951 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e849aee-d3d1-42d0-bf7e-c1996b2abc35 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:52.198439 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e849aee-d3d1-42d0-bf7e-c1996b2abc35 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:52.198872 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e849aee-d3d1-42d0-bf7e-c1996b2abc35 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:52.199567 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e849aee-d3d1-42d0-bf7e-c1996b2abc35 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:52.200093 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e849aee-d3d1-42d0-bf7e-c1996b2abc35 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:52.200516 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e849aee-d3d1-42d0-bf7e-c1996b2abc35 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:52.207345 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ebf5fd47-7d37-4cb6-beec-95366002bb6a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:52.208282 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ebf5fd47-7d37-4cb6-beec-95366002bb6a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:52.214712 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebf5fd47-7d37-4cb6-beec-95366002bb6a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:52.215197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebf5fd47-7d37-4cb6-beec-95366002bb6a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:52.215628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebf5fd47-7d37-4cb6-beec-95366002bb6a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:52.216336 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebf5fd47-7d37-4cb6-beec-95366002bb6a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:52.216810 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebf5fd47-7d37-4cb6-beec-95366002bb6a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:52.217235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebf5fd47-7d37-4cb6-beec-95366002bb6a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:52.313482 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ebf5fd47-7d37-4cb6-beec-95366002bb6a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:52.322284 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ebf5fd47-7d37-4cb6-beec-95366002bb6a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1271 microversion: 2.1 time: 0.120538 Sep 17 21:15:52.323092 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 540/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:52 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:52.368396 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e849aee-d3d1-42d0-bf7e-c1996b2abc35 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:52.376822 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e849aee-d3d1-42d0-bf7e-c1996b2abc35 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.191777 Sep 17 21:15:52.377395 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 508/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:52 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:53.348227 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2293e700-8aa1-4780-a68a-5a927513f306 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:53.348999 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2293e700-8aa1-4780-a68a-5a927513f306 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:53.355804 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2293e700-8aa1-4780-a68a-5a927513f306 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:53.356368 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2293e700-8aa1-4780-a68a-5a927513f306 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:53.356921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2293e700-8aa1-4780-a68a-5a927513f306 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:53.357716 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2293e700-8aa1-4780-a68a-5a927513f306 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:53.358261 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2293e700-8aa1-4780-a68a-5a927513f306 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:53.358763 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2293e700-8aa1-4780-a68a-5a927513f306 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:53.400060 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-132273b5-ab0f-4624-b2fe-c15a821a61de tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:53.400788 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-132273b5-ab0f-4624-b2fe-c15a821a61de tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:53.409476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-132273b5-ab0f-4624-b2fe-c15a821a61de tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:53.410429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-132273b5-ab0f-4624-b2fe-c15a821a61de tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:53.411041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-132273b5-ab0f-4624-b2fe-c15a821a61de tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:53.411848 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-132273b5-ab0f-4624-b2fe-c15a821a61de tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:53.412386 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-132273b5-ab0f-4624-b2fe-c15a821a61de tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:53.413043 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-132273b5-ab0f-4624-b2fe-c15a821a61de tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:53.427776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2293e700-8aa1-4780-a68a-5a927513f306 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:53.438082 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2293e700-8aa1-4780-a68a-5a927513f306 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1271 microversion: 2.1 time: 0.097056 Sep 17 21:15:53.438916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 541/1049] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:53 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:53.548859 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-132273b5-ab0f-4624-b2fe-c15a821a61de tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:53.556481 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-132273b5-ab0f-4624-b2fe-c15a821a61de tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.160978 Sep 17 21:15:53.557260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 509/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:53 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:15:54.464625 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-95a74e14-c7aa-4d78-a7f4-df0d6a934bf9 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:54.465293 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-95a74e14-c7aa-4d78-a7f4-df0d6a934bf9 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:54.479601 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95a74e14-c7aa-4d78-a7f4-df0d6a934bf9 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:54.480421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95a74e14-c7aa-4d78-a7f4-df0d6a934bf9 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:54.481185 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95a74e14-c7aa-4d78-a7f4-df0d6a934bf9 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:54.482219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95a74e14-c7aa-4d78-a7f4-df0d6a934bf9 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:54.482990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95a74e14-c7aa-4d78-a7f4-df0d6a934bf9 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:54.483650 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95a74e14-c7aa-4d78-a7f4-df0d6a934bf9 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:54.575340 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-95a74e14-c7aa-4d78-a7f4-df0d6a934bf9 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:54.580462 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9039ff4f-f6ca-4088-a81f-4ea04c33dc03 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:54.581180 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9039ff4f-f6ca-4088-a81f-4ea04c33dc03 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:54.585168 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-95a74e14-c7aa-4d78-a7f4-df0d6a934bf9 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1277 microversion: 2.1 time: 0.127614 Sep 17 21:15:54.586670 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 542/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:54 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:54.590023 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9039ff4f-f6ca-4088-a81f-4ea04c33dc03 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:54.590512 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9039ff4f-f6ca-4088-a81f-4ea04c33dc03 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:54.590936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9039ff4f-f6ca-4088-a81f-4ea04c33dc03 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:54.591641 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9039ff4f-f6ca-4088-a81f-4ea04c33dc03 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:54.592106 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9039ff4f-f6ca-4088-a81f-4ea04c33dc03 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:54.595831 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9039ff4f-f6ca-4088-a81f-4ea04c33dc03 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:54.806224 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9039ff4f-f6ca-4088-a81f-4ea04c33dc03 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:54.822631 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9039ff4f-f6ca-4088-a81f-4ea04c33dc03 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.245899 Sep 17 21:15:54.823413 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 510/1052] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:54 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:15:55.509782 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a1a0fd31-3212-44d3-b381-55c5043bcba3 req-72b29bdb-3cd6-4fa0-8b18-124b1560c353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c7c925-ef34-4794-86f0-6b405ae816e4", "tag": "fb6fb3b5-c3b5-4cac-a927-b3f12ca803c1"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:55.520422 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a1a0fd31-3212-44d3-b381-55c5043bcba3 req-72b29bdb-3cd6-4fa0-8b18-124b1560c353 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:55.520954 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a1a0fd31-3212-44d3-b381-55c5043bcba3 req-72b29bdb-3cd6-4fa0-8b18-124b1560c353 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:55.521388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a1a0fd31-3212-44d3-b381-55c5043bcba3 req-72b29bdb-3cd6-4fa0-8b18-124b1560c353 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:55.533098 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a1a0fd31-3212-44d3-b381-55c5043bcba3 req-72b29bdb-3cd6-4fa0-8b18-124b1560c353 service nova] Creating event network-changed:fb6fb3b5-c3b5-4cac-a927-b3f12ca803c1 for instance e3c7c925-ef34-4794-86f0-6b405ae816e4 on hv-cinder-82651 Sep 17 21:15:55.540175 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a1a0fd31-3212-44d3-b381-55c5043bcba3 req-72b29bdb-3cd6-4fa0-8b18-124b1560c353 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033934 Sep 17 21:15:55.540932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 543/1053] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:15:55.615433 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-68fd7a8d-1b06-4afe-92f3-3a0bc71fd3a7 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:55.616759 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-68fd7a8d-1b06-4afe-92f3-3a0bc71fd3a7 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:55.623140 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68fd7a8d-1b06-4afe-92f3-3a0bc71fd3a7 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:55.623621 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68fd7a8d-1b06-4afe-92f3-3a0bc71fd3a7 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:55.624175 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68fd7a8d-1b06-4afe-92f3-3a0bc71fd3a7 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:55.625322 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68fd7a8d-1b06-4afe-92f3-3a0bc71fd3a7 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:55.625749 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68fd7a8d-1b06-4afe-92f3-3a0bc71fd3a7 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:55.626256 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68fd7a8d-1b06-4afe-92f3-3a0bc71fd3a7 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:55.779956 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-68fd7a8d-1b06-4afe-92f3-3a0bc71fd3a7 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:55.788901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-68fd7a8d-1b06-4afe-92f3-3a0bc71fd3a7 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1319 microversion: 2.1 time: 0.177206 Sep 17 21:15:55.789716 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 511/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:55 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:55.848198 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cadd31c8-c217-441f-91a3-98dd60d4d97b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:55.849087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cadd31c8-c217-441f-91a3-98dd60d4d97b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:55.855324 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cadd31c8-c217-441f-91a3-98dd60d4d97b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:55.856045 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cadd31c8-c217-441f-91a3-98dd60d4d97b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:55.856489 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cadd31c8-c217-441f-91a3-98dd60d4d97b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:55.857249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cadd31c8-c217-441f-91a3-98dd60d4d97b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:55.857717 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cadd31c8-c217-441f-91a3-98dd60d4d97b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:55.858141 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cadd31c8-c217-441f-91a3-98dd60d4d97b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:56.015626 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cadd31c8-c217-441f-91a3-98dd60d4d97b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:56.023999 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cadd31c8-c217-441f-91a3-98dd60d4d97b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.180491 Sep 17 21:15:56.024464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 544/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:55 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:56.811558 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c6dbc0e-e76f-4b99-a7e8-7aada3cd26dc tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:56.812838 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9c6dbc0e-e76f-4b99-a7e8-7aada3cd26dc tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:56.819631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c6dbc0e-e76f-4b99-a7e8-7aada3cd26dc tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:56.820121 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c6dbc0e-e76f-4b99-a7e8-7aada3cd26dc tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:56.821094 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c6dbc0e-e76f-4b99-a7e8-7aada3cd26dc tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:56.821967 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c6dbc0e-e76f-4b99-a7e8-7aada3cd26dc tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:56.822418 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c6dbc0e-e76f-4b99-a7e8-7aada3cd26dc tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:56.822833 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c6dbc0e-e76f-4b99-a7e8-7aada3cd26dc tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:56.899898 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3d6edfb5-1a87-4e37-bcec-96dc2bbf5d5f req-6537825f-76ff-426d-900c-6ba8b353227d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb470a89-d7ed-49bd-b7d0-1141d8410aeb", "name": "network-vif-plugged", "status": "completed", "tag": "1cb82103-f71c-4280-8b52-006d0dc82f48"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:56.912712 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3d6edfb5-1a87-4e37-bcec-96dc2bbf5d5f req-6537825f-76ff-426d-900c-6ba8b353227d service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:56.913273 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3d6edfb5-1a87-4e37-bcec-96dc2bbf5d5f req-6537825f-76ff-426d-900c-6ba8b353227d service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:56.913774 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3d6edfb5-1a87-4e37-bcec-96dc2bbf5d5f req-6537825f-76ff-426d-900c-6ba8b353227d service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:56.926133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3d6edfb5-1a87-4e37-bcec-96dc2bbf5d5f req-6537825f-76ff-426d-900c-6ba8b353227d service nova] Creating event network-vif-plugged:1cb82103-f71c-4280-8b52-006d0dc82f48 for instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb on hv-cinder-82651 Sep 17 21:15:56.931773 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3d6edfb5-1a87-4e37-bcec-96dc2bbf5d5f req-6537825f-76ff-426d-900c-6ba8b353227d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194241 Sep 17 21:15:56.932463 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 512/1056] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:15:56.978212 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9c6dbc0e-e76f-4b99-a7e8-7aada3cd26dc tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:56.989506 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c6dbc0e-e76f-4b99-a7e8-7aada3cd26dc tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1319 microversion: 2.1 time: 0.181916 Sep 17 21:15:56.990069 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 545/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:56 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:15:57.048056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06b1c28c-43b6-4947-bb8e-8c6d2d8d07ab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:57.048899 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06b1c28c-43b6-4947-bb8e-8c6d2d8d07ab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:57.055012 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b1c28c-43b6-4947-bb8e-8c6d2d8d07ab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:57.055559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b1c28c-43b6-4947-bb8e-8c6d2d8d07ab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:57.055922 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b1c28c-43b6-4947-bb8e-8c6d2d8d07ab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:57.056648 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b1c28c-43b6-4947-bb8e-8c6d2d8d07ab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:57.057136 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b1c28c-43b6-4947-bb8e-8c6d2d8d07ab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:57.057554 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b1c28c-43b6-4947-bb8e-8c6d2d8d07ab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:57.197192 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-06b1c28c-43b6-4947-bb8e-8c6d2d8d07ab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:57.206033 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06b1c28c-43b6-4947-bb8e-8c6d2d8d07ab tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.162962 Sep 17 21:15:57.206594 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 513/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:57 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:58.012177 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea4769b4-b239-430c-b6a9-79184984ef86 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:58.012819 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea4769b4-b239-430c-b6a9-79184984ef86 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:58.018870 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4769b4-b239-430c-b6a9-79184984ef86 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:58.019351 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4769b4-b239-430c-b6a9-79184984ef86 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:58.019834 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4769b4-b239-430c-b6a9-79184984ef86 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:58.020538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4769b4-b239-430c-b6a9-79184984ef86 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:58.025116 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4769b4-b239-430c-b6a9-79184984ef86 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:58.025819 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4769b4-b239-430c-b6a9-79184984ef86 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:58.167415 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea4769b4-b239-430c-b6a9-79184984ef86 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:58.177041 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea4769b4-b239-430c-b6a9-79184984ef86 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1319 microversion: 2.1 time: 0.168660 Sep 17 21:15:58.182461 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 546/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:58 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:58.228692 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8d46bad5-681a-4b2c-a646-372d5831cc3f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:58.229322 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8d46bad5-681a-4b2c-a646-372d5831cc3f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:58.237007 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d46bad5-681a-4b2c-a646-372d5831cc3f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:58.237575 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d46bad5-681a-4b2c-a646-372d5831cc3f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:58.238015 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d46bad5-681a-4b2c-a646-372d5831cc3f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:58.238719 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d46bad5-681a-4b2c-a646-372d5831cc3f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:58.239179 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d46bad5-681a-4b2c-a646-372d5831cc3f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:58.239607 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d46bad5-681a-4b2c-a646-372d5831cc3f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:58.376844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d46bad5-681a-4b2c-a646-372d5831cc3f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:58.385285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8d46bad5-681a-4b2c-a646-372d5831cc3f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.160007 Sep 17 21:15:58.386111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 514/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:58 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:59.202898 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f4b1ca52-dac8-4014-b53c-d877eaac2b8d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:59.203978 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f4b1ca52-dac8-4014-b53c-d877eaac2b8d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:59.211627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4b1ca52-dac8-4014-b53c-d877eaac2b8d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:59.212122 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4b1ca52-dac8-4014-b53c-d877eaac2b8d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:59.212573 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4b1ca52-dac8-4014-b53c-d877eaac2b8d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:59.213317 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4b1ca52-dac8-4014-b53c-d877eaac2b8d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:59.213783 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4b1ca52-dac8-4014-b53c-d877eaac2b8d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:59.214214 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4b1ca52-dac8-4014-b53c-d877eaac2b8d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:59.365696 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f4b1ca52-dac8-4014-b53c-d877eaac2b8d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:59.375347 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f4b1ca52-dac8-4014-b53c-d877eaac2b8d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1319 microversion: 2.1 time: 0.176898 Sep 17 21:15:59.376089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 547/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:59 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:59.409248 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9919aebc-14cc-4272-ae3f-27257edb00d7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:59.410806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9919aebc-14cc-4272-ae3f-27257edb00d7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:59.416407 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9919aebc-14cc-4272-ae3f-27257edb00d7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:59.416896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9919aebc-14cc-4272-ae3f-27257edb00d7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:59.417335 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9919aebc-14cc-4272-ae3f-27257edb00d7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:59.418036 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9919aebc-14cc-4272-ae3f-27257edb00d7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:59.418503 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9919aebc-14cc-4272-ae3f-27257edb00d7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:59.418925 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9919aebc-14cc-4272-ae3f-27257edb00d7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:59.578573 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9919aebc-14cc-4272-ae3f-27257edb00d7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:59.586467 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9919aebc-14cc-4272-ae3f-27257edb00d7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1359 microversion: 2.1 time: 0.181088 Sep 17 21:15:59.587260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 515/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:59 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:00.400696 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c43e966-4834-41c4-80c2-8aa960e1eeef tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:00.401382 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8c43e966-4834-41c4-80c2-8aa960e1eeef tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:00.409030 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c43e966-4834-41c4-80c2-8aa960e1eeef tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:00.409513 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c43e966-4834-41c4-80c2-8aa960e1eeef tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:00.409950 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c43e966-4834-41c4-80c2-8aa960e1eeef tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:00.410637 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c43e966-4834-41c4-80c2-8aa960e1eeef tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:00.411089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c43e966-4834-41c4-80c2-8aa960e1eeef tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:00.411509 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c43e966-4834-41c4-80c2-8aa960e1eeef tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:00.542036 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8c43e966-4834-41c4-80c2-8aa960e1eeef tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:00.550147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8c43e966-4834-41c4-80c2-8aa960e1eeef tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1319 microversion: 2.1 time: 0.153531 Sep 17 21:16:00.553113 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 548/1063] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:00 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:00.610813 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-17de5ab0-bedf-4660-af27-c11b5f586af6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:00.611535 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-17de5ab0-bedf-4660-af27-c11b5f586af6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:00.618217 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17de5ab0-bedf-4660-af27-c11b5f586af6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:00.618868 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17de5ab0-bedf-4660-af27-c11b5f586af6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:00.619473 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17de5ab0-bedf-4660-af27-c11b5f586af6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:00.620333 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17de5ab0-bedf-4660-af27-c11b5f586af6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:00.620972 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17de5ab0-bedf-4660-af27-c11b5f586af6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:00.621480 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17de5ab0-bedf-4660-af27-c11b5f586af6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:00.732756 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-cf4e0319-0795-472f-b110-7213c472cc60 req-67561698-c4a2-4b0e-b48c-9df73a0c54aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c7c925-ef34-4794-86f0-6b405ae816e4", "name": "network-vif-plugged", "status": "completed", "tag": "fb6fb3b5-c3b5-4cac-a927-b3f12ca803c1"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:00.744947 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cf4e0319-0795-472f-b110-7213c472cc60 req-67561698-c4a2-4b0e-b48c-9df73a0c54aa service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:00.745525 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cf4e0319-0795-472f-b110-7213c472cc60 req-67561698-c4a2-4b0e-b48c-9df73a0c54aa service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:00.746305 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cf4e0319-0795-472f-b110-7213c472cc60 req-67561698-c4a2-4b0e-b48c-9df73a0c54aa service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:00.756452 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-17de5ab0-bedf-4660-af27-c11b5f586af6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:00.758413 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-cf4e0319-0795-472f-b110-7213c472cc60 req-67561698-c4a2-4b0e-b48c-9df73a0c54aa service nova] Creating event network-vif-plugged:fb6fb3b5-c3b5-4cac-a927-b3f12ca803c1 for instance e3c7c925-ef34-4794-86f0-6b405ae816e4 on hv-cinder-82651 Sep 17 21:16:00.763451 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-cf4e0319-0795-472f-b110-7213c472cc60 req-67561698-c4a2-4b0e-b48c-9df73a0c54aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034957 Sep 17 21:16:00.764048 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 549/1064] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:16:00.765825 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-17de5ab0-bedf-4660-af27-c11b5f586af6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1549 microversion: 2.1 time: 0.158830 Sep 17 21:16:00.766390 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 516/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:00 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:00.789625 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-54969e5c-a4d9-4c52-9627-6e89970b31ba tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:00.790067 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-54969e5c-a4d9-4c52-9627-6e89970b31ba tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:00.796174 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54969e5c-a4d9-4c52-9627-6e89970b31ba tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:00.797306 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54969e5c-a4d9-4c52-9627-6e89970b31ba tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:00.797755 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54969e5c-a4d9-4c52-9627-6e89970b31ba tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:00.798462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54969e5c-a4d9-4c52-9627-6e89970b31ba tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:00.799127 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54969e5c-a4d9-4c52-9627-6e89970b31ba tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:00.799956 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54969e5c-a4d9-4c52-9627-6e89970b31ba tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:00.951619 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-54969e5c-a4d9-4c52-9627-6e89970b31ba tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:00.960298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-54969e5c-a4d9-4c52-9627-6e89970b31ba tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1549 microversion: 2.1 time: 0.175131 Sep 17 21:16:00.960884 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 550/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:00 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:00.983132 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-76b869fd-0614-4b5f-a6f5-7a327fd619e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:00.989186 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-76b869fd-0614-4b5f-a6f5-7a327fd619e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:00.989955 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-76b869fd-0614-4b5f-a6f5-7a327fd619e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Searching by: {'deleted': False, 'project_id': '84fb17d896e344aa8c871bf741305304'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:16:00.991895 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:00.998127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76b869fd-0614-4b5f-a6f5-7a327fd619e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:00.998620 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76b869fd-0614-4b5f-a6f5-7a327fd619e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:00.999055 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76b869fd-0614-4b5f-a6f5-7a327fd619e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:01.000535 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76b869fd-0614-4b5f-a6f5-7a327fd619e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:01.001461 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76b869fd-0614-4b5f-a6f5-7a327fd619e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:01.001782 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76b869fd-0614-4b5f-a6f5-7a327fd619e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:01.092292 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-76b869fd-0614-4b5f-a6f5-7a327fd619e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:16:01.170938 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:01.192247 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-76b869fd-0614-4b5f-a6f5-7a327fd619e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212893 Sep 17 21:16:01.193041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 517/1067] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 17 21:16:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:01.204858 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee66e2a6-4386-4c57-953e-de9533a2f632 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:01.205410 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee66e2a6-4386-4c57-953e-de9533a2f632 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:01.211308 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee66e2a6-4386-4c57-953e-de9533a2f632 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:01.211794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee66e2a6-4386-4c57-953e-de9533a2f632 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:01.212242 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee66e2a6-4386-4c57-953e-de9533a2f632 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:01.212960 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee66e2a6-4386-4c57-953e-de9533a2f632 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:01.213420 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee66e2a6-4386-4c57-953e-de9533a2f632 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:01.213847 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee66e2a6-4386-4c57-953e-de9533a2f632 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:01.351715 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee66e2a6-4386-4c57-953e-de9533a2f632 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:01.359600 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee66e2a6-4386-4c57-953e-de9533a2f632 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1549 microversion: 2.1 time: 0.159076 Sep 17 21:16:01.360417 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 551/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:01 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:01.580930 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd1bc7a9-fb32-4746-9d5f-09c9770fbda5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:01.581632 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd1bc7a9-fb32-4746-9d5f-09c9770fbda5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:01.588590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd1bc7a9-fb32-4746-9d5f-09c9770fbda5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:01.596131 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd1bc7a9-fb32-4746-9d5f-09c9770fbda5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:01.596131 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd1bc7a9-fb32-4746-9d5f-09c9770fbda5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:01.596131 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd1bc7a9-fb32-4746-9d5f-09c9770fbda5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:01.596131 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd1bc7a9-fb32-4746-9d5f-09c9770fbda5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:01.596919 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd1bc7a9-fb32-4746-9d5f-09c9770fbda5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:01.756960 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dd1bc7a9-fb32-4746-9d5f-09c9770fbda5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:01.765865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd1bc7a9-fb32-4746-9d5f-09c9770fbda5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1319 microversion: 2.1 time: 0.189320 Sep 17 21:16:01.766534 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 518/1069] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:01 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:02.788589 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4de1c0d1-752f-45fe-9df1-8a8faed117fe tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:02.789235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4de1c0d1-752f-45fe-9df1-8a8faed117fe tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:02.795590 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4de1c0d1-752f-45fe-9df1-8a8faed117fe tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:02.796072 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4de1c0d1-752f-45fe-9df1-8a8faed117fe tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:02.796595 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4de1c0d1-752f-45fe-9df1-8a8faed117fe tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:02.797330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4de1c0d1-752f-45fe-9df1-8a8faed117fe tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:02.797776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4de1c0d1-752f-45fe-9df1-8a8faed117fe tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:02.798196 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4de1c0d1-752f-45fe-9df1-8a8faed117fe tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:02.933118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4de1c0d1-752f-45fe-9df1-8a8faed117fe tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:02.946421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4de1c0d1-752f-45fe-9df1-8a8faed117fe tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1508 microversion: 2.1 time: 0.161614 Sep 17 21:16:02.947063 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 552/1070] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:02 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:02.983364 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e8808c63-5dd4-431b-b3b7-431e0d1367e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3849dc0-590c-4d28-9d36-5274e0cf34a6"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:02.986639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e8808c63-5dd4-431b-b3b7-431e0d1367e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:02.993049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8808c63-5dd4-431b-b3b7-431e0d1367e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:02.993185 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8808c63-5dd4-431b-b3b7-431e0d1367e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:02.993560 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8808c63-5dd4-431b-b3b7-431e0d1367e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:02.994258 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8808c63-5dd4-431b-b3b7-431e0d1367e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:02.994711 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8808c63-5dd4-431b-b3b7-431e0d1367e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:02.995133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8808c63-5dd4-431b-b3b7-431e0d1367e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:03.400748 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e8808c63-5dd4-431b-b3b7-431e0d1367e8 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "POST /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421261 Sep 17 21:16:03.401501 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 519/1071] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:16:02 2022] POST /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:10.571160 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-369706632", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "networks": [{"uuid": "79573bf9-f27c-4dbb-bc1a-839c0147cc1b"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:10.625742 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] validate_networks() for [('79573bf9-f27c-4dbb-bc1a-839c0147cc1b', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:16:11.046415 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:16:11.047031 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:16:11.047828 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:16:11.048347 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:16:11.048990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:16:11.058473 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:11.058949 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:11.059379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:11.060097 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:11.060576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:11.061022 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:11.071509 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf67e59f-e5e8-4db9-a3cf-3e9c270c3e64 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:11.072124 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cf67e59f-e5e8-4db9-a3cf-3e9c270c3e64 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:11.074613 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:11.080821 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf67e59f-e5e8-4db9-a3cf-3e9c270c3e64 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:11.081311 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf67e59f-e5e8-4db9-a3cf-3e9c270c3e64 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:11.081743 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf67e59f-e5e8-4db9-a3cf-3e9c270c3e64 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:11.081953 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Getting quotas for project 66a629d38940403aa7ee49b68f1d8ecf. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:16:11.082437 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf67e59f-e5e8-4db9-a3cf-3e9c270c3e64 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:11.082890 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf67e59f-e5e8-4db9-a3cf-3e9c270c3e64 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:11.083308 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf67e59f-e5e8-4db9-a3cf-3e9c270c3e64 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:11.085896 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Getting quotas for user 21a22c69a4e54c7896fa8e745d1dfc38 and project 66a629d38940403aa7ee49b68f1d8ecf. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:16:11.097933 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:16:11.100211 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:16:11.145413 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [931a2ecc-662a-4fd3-9938-3ca1484612f1] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 21:16:11.217649 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf67e59f-e5e8-4db9-a3cf-3e9c270c3e64 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:11.226387 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf67e59f-e5e8-4db9-a3cf-3e9c270c3e64 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1595 microversion: 2.1 time: 0.159075 Sep 17 21:16:11.226952 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 520/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:11 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:12.153970 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [931a2ecc-662a-4fd3-9938-3ca1484612f1] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53564. Sep 17 21:16:12.166203 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ffdd63e8-e03e-4a01-b7ed-b81c1c24e4ff tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595797 Sep 17 21:16:12.166203 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 553/1073] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:16:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:16:12.175761 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-414169b7-6abb-4845-94a4-2bf0f7abdec6 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:12.176460 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-414169b7-6abb-4845-94a4-2bf0f7abdec6 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:12.239711 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-414169b7-6abb-4845-94a4-2bf0f7abdec6 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:12.247306 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-414169b7-6abb-4845-94a4-2bf0f7abdec6 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1213 microversion: 2.1 time: 0.076115 Sep 17 21:16:12.248439 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 521/1074] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:12 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:13.271570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a41b5fbf-db5c-4102-9b78-f8f16354edf9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:13.272901 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a41b5fbf-db5c-4102-9b78-f8f16354edf9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:13.284932 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a41b5fbf-db5c-4102-9b78-f8f16354edf9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:13.288127 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a41b5fbf-db5c-4102-9b78-f8f16354edf9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:13.288782 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a41b5fbf-db5c-4102-9b78-f8f16354edf9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:13.289679 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a41b5fbf-db5c-4102-9b78-f8f16354edf9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:13.298177 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a41b5fbf-db5c-4102-9b78-f8f16354edf9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:13.298625 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a41b5fbf-db5c-4102-9b78-f8f16354edf9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:13.358756 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-f295c0ca-1d93-4763-81d0-b6ac42201741 req-1fec35de-162b-4ecb-935a-02fb6b4720e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb470a89-d7ed-49bd-b7d0-1141d8410aeb", "tag": "1cb82103-f71c-4280-8b52-006d0dc82f48"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:13.384165 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f295c0ca-1d93-4763-81d0-b6ac42201741 req-1fec35de-162b-4ecb-935a-02fb6b4720e5 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:13.385156 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f295c0ca-1d93-4763-81d0-b6ac42201741 req-1fec35de-162b-4ecb-935a-02fb6b4720e5 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:13.388233 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f295c0ca-1d93-4763-81d0-b6ac42201741 req-1fec35de-162b-4ecb-935a-02fb6b4720e5 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:13.410828 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-f295c0ca-1d93-4763-81d0-b6ac42201741 req-1fec35de-162b-4ecb-935a-02fb6b4720e5 service nova] Creating event network-changed:1cb82103-f71c-4280-8b52-006d0dc82f48 for instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb on hv-cinder-82651 Sep 17 21:16:13.417592 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-f295c0ca-1d93-4763-81d0-b6ac42201741 req-1fec35de-162b-4ecb-935a-02fb6b4720e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218006 Sep 17 21:16:13.419230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 554/1075] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:13.427615 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a41b5fbf-db5c-4102-9b78-f8f16354edf9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:13.439071 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a41b5fbf-db5c-4102-9b78-f8f16354edf9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1265 microversion: 2.1 time: 0.171137 Sep 17 21:16:13.441420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 522/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:13 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:14.467157 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d6b512e1-9d28-4ecc-9dd8-72f1f15b9134 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:14.467792 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d6b512e1-9d28-4ecc-9dd8-72f1f15b9134 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:14.474061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6b512e1-9d28-4ecc-9dd8-72f1f15b9134 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:14.474868 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6b512e1-9d28-4ecc-9dd8-72f1f15b9134 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:14.475459 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6b512e1-9d28-4ecc-9dd8-72f1f15b9134 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:14.476388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6b512e1-9d28-4ecc-9dd8-72f1f15b9134 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:14.477084 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6b512e1-9d28-4ecc-9dd8-72f1f15b9134 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:14.477712 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6b512e1-9d28-4ecc-9dd8-72f1f15b9134 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:14.680599 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d6b512e1-9d28-4ecc-9dd8-72f1f15b9134 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:14.689920 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d6b512e1-9d28-4ecc-9dd8-72f1f15b9134 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1313 microversion: 2.1 time: 0.228521 Sep 17 21:16:14.690775 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 555/1077] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:14 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:14.765130 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7644f78e-3740-4c45-9c92-dbdb7560c3dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1622856418"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:14.765806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7644f78e-3740-4c45-9c92-dbdb7560c3dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:14.772214 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7644f78e-3740-4c45-9c92-dbdb7560c3dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:14.772716 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7644f78e-3740-4c45-9c92-dbdb7560c3dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:14.773148 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7644f78e-3740-4c45-9c92-dbdb7560c3dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:14.774008 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7644f78e-3740-4c45-9c92-dbdb7560c3dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:14.774463 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7644f78e-3740-4c45-9c92-dbdb7560c3dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:14.774885 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7644f78e-3740-4c45-9c92-dbdb7560c3dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:14.902484 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.network.security_group_api [None req-7644f78e-3740-4c45-9c92-dbdb7560c3dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Adding security group 4ad3dd1d-26bf-4f76-af0f-78372790e408 to port 1cb82103-f71c-4280-8b52-006d0dc82f48 Sep 17 21:16:15.236163 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7644f78e-3740-4c45-9c92-dbdb7560c3dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "POST /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/action" status: 202 len: 0 microversion: 2.1 time: 0.474981 Sep 17 21:16:15.236806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 523/1078] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:16:14 2022] POST /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:16:15.244838 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1d0500a-b300-4375-b05c-62f4593c9c59 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:15.245866 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e1d0500a-b300-4375-b05c-62f4593c9c59 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:15.255654 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d0500a-b300-4375-b05c-62f4593c9c59 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:15.256519 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d0500a-b300-4375-b05c-62f4593c9c59 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:15.256667 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1e614993-30c4-4064-9f44-fcced991b851 req-818f1376-a64b-451b-b245-2d70c7b07f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb470a89-d7ed-49bd-b7d0-1141d8410aeb", "tag": "1cb82103-f71c-4280-8b52-006d0dc82f48"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:15.256830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d0500a-b300-4375-b05c-62f4593c9c59 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:15.259589 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d0500a-b300-4375-b05c-62f4593c9c59 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:15.260065 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d0500a-b300-4375-b05c-62f4593c9c59 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:15.260875 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d0500a-b300-4375-b05c-62f4593c9c59 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:15.281311 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1e614993-30c4-4064-9f44-fcced991b851 req-818f1376-a64b-451b-b245-2d70c7b07f54 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:15.282086 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1e614993-30c4-4064-9f44-fcced991b851 req-818f1376-a64b-451b-b245-2d70c7b07f54 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:15.282692 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1e614993-30c4-4064-9f44-fcced991b851 req-818f1376-a64b-451b-b245-2d70c7b07f54 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:15.296185 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1e614993-30c4-4064-9f44-fcced991b851 req-818f1376-a64b-451b-b245-2d70c7b07f54 service nova] Creating event network-changed:1cb82103-f71c-4280-8b52-006d0dc82f48 for instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb on hv-cinder-82651 Sep 17 21:16:15.306182 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1e614993-30c4-4064-9f44-fcced991b851 req-818f1376-a64b-451b-b245-2d70c7b07f54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053225 Sep 17 21:16:15.307405 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 524/1079] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:16:15.460061 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6d0310b1-8f8b-4a5f-98f4-c6fdd339f92b req-30c32837-2426-48c3-b4e0-07bd20b45577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aadebbd0-1e96-47aa-89b3-7202bea1ad3f", "tag": "bb75961b-d562-4322-a7ad-a6ff6aa97716"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:15.473315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6d0310b1-8f8b-4a5f-98f4-c6fdd339f92b req-30c32837-2426-48c3-b4e0-07bd20b45577 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:15.474206 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6d0310b1-8f8b-4a5f-98f4-c6fdd339f92b req-30c32837-2426-48c3-b4e0-07bd20b45577 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:15.474874 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6d0310b1-8f8b-4a5f-98f4-c6fdd339f92b req-30c32837-2426-48c3-b4e0-07bd20b45577 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:15.489482 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6d0310b1-8f8b-4a5f-98f4-c6fdd339f92b req-30c32837-2426-48c3-b4e0-07bd20b45577 service nova] Creating event network-changed:bb75961b-d562-4322-a7ad-a6ff6aa97716 for instance aadebbd0-1e96-47aa-89b3-7202bea1ad3f on hv-cinder-82651 Sep 17 21:16:15.495569 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6d0310b1-8f8b-4a5f-98f4-c6fdd339f92b req-30c32837-2426-48c3-b4e0-07bd20b45577 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040402 Sep 17 21:16:15.496874 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 525/1080] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:16:15.554297 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e1d0500a-b300-4375-b05c-62f4593c9c59 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:15.565535 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1d0500a-b300-4375-b05c-62f4593c9c59 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1761 microversion: 2.1 time: 0.324364 Sep 17 21:16:15.566805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 556/1081] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:15 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1761 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:15.717604 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e73e00e4-1638-42dc-b58c-2514278ea91f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:15.718322 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e73e00e4-1638-42dc-b58c-2514278ea91f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:15.726950 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e73e00e4-1638-42dc-b58c-2514278ea91f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:15.727750 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e73e00e4-1638-42dc-b58c-2514278ea91f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:15.728023 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e73e00e4-1638-42dc-b58c-2514278ea91f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:15.728989 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e73e00e4-1638-42dc-b58c-2514278ea91f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:15.729224 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e73e00e4-1638-42dc-b58c-2514278ea91f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:15.729651 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e73e00e4-1638-42dc-b58c-2514278ea91f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:15.735086 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:15.870893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e73e00e4-1638-42dc-b58c-2514278ea91f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:15.878693 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e73e00e4-1638-42dc-b58c-2514278ea91f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1313 microversion: 2.1 time: 0.166812 Sep 17 21:16:15.879262 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 526/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:15 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:16.902311 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c7837aa5-1ac0-417c-bb99-3132450f3cf0 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:16.902923 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c7837aa5-1ac0-417c-bb99-3132450f3cf0 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:16.909304 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7837aa5-1ac0-417c-bb99-3132450f3cf0 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:16.909784 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7837aa5-1ac0-417c-bb99-3132450f3cf0 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:16.910219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7837aa5-1ac0-417c-bb99-3132450f3cf0 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:16.910909 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7837aa5-1ac0-417c-bb99-3132450f3cf0 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:16.911364 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7837aa5-1ac0-417c-bb99-3132450f3cf0 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:16.911789 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7837aa5-1ac0-417c-bb99-3132450f3cf0 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:17.037955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c7837aa5-1ac0-417c-bb99-3132450f3cf0 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:17.045505 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7837aa5-1ac0-417c-bb99-3132450f3cf0 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1313 microversion: 2.1 time: 0.147144 Sep 17 21:16:17.046067 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 557/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:16 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:18.069284 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47d99a48-7457-47bc-b8c1-d77cedf1e804 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:18.069886 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-47d99a48-7457-47bc-b8c1-d77cedf1e804 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:18.076240 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47d99a48-7457-47bc-b8c1-d77cedf1e804 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:18.076741 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47d99a48-7457-47bc-b8c1-d77cedf1e804 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:18.077171 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47d99a48-7457-47bc-b8c1-d77cedf1e804 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:18.077882 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47d99a48-7457-47bc-b8c1-d77cedf1e804 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:18.078446 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47d99a48-7457-47bc-b8c1-d77cedf1e804 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:18.078856 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47d99a48-7457-47bc-b8c1-d77cedf1e804 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:18.210106 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-47d99a48-7457-47bc-b8c1-d77cedf1e804 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:18.217761 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-47d99a48-7457-47bc-b8c1-d77cedf1e804 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1313 microversion: 2.1 time: 0.152356 Sep 17 21:16:18.219039 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 527/1084] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:18 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:19.240860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-487b4931-33bb-41ce-a828-0a4102a74beb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:19.241526 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-487b4931-33bb-41ce-a828-0a4102a74beb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:19.247916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-487b4931-33bb-41ce-a828-0a4102a74beb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:19.248398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-487b4931-33bb-41ce-a828-0a4102a74beb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:19.248882 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-487b4931-33bb-41ce-a828-0a4102a74beb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:19.249639 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-487b4931-33bb-41ce-a828-0a4102a74beb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:19.250371 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-487b4931-33bb-41ce-a828-0a4102a74beb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:19.250827 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-487b4931-33bb-41ce-a828-0a4102a74beb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:19.253504 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:19.476697 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-487b4931-33bb-41ce-a828-0a4102a74beb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:19.485171 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-487b4931-33bb-41ce-a828-0a4102a74beb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1313 microversion: 2.1 time: 0.247897 Sep 17 21:16:19.485837 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 558/1085] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:19 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:20.508647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d9684c6-ec96-422e-88a1-4bcdf8258bd4 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:20.509266 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d9684c6-ec96-422e-88a1-4bcdf8258bd4 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:20.516119 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d9684c6-ec96-422e-88a1-4bcdf8258bd4 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:20.516571 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d9684c6-ec96-422e-88a1-4bcdf8258bd4 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:20.517021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d9684c6-ec96-422e-88a1-4bcdf8258bd4 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:20.517701 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d9684c6-ec96-422e-88a1-4bcdf8258bd4 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:20.518148 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d9684c6-ec96-422e-88a1-4bcdf8258bd4 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:20.518564 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d9684c6-ec96-422e-88a1-4bcdf8258bd4 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:20.650260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d9684c6-ec96-422e-88a1-4bcdf8258bd4 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:20.658926 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d9684c6-ec96-422e-88a1-4bcdf8258bd4 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1313 microversion: 2.1 time: 0.154098 Sep 17 21:16:20.659499 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 528/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:20 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:21.682500 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-deefca91-86a1-46b9-8da1-9e23f1c5e84e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:21.683036 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-deefca91-86a1-46b9-8da1-9e23f1c5e84e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:21.685333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:21.685996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:21.686644 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:21.692938 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-deefca91-86a1-46b9-8da1-9e23f1c5e84e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:21.693421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-deefca91-86a1-46b9-8da1-9e23f1c5e84e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:21.693855 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-deefca91-86a1-46b9-8da1-9e23f1c5e84e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:21.694549 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-deefca91-86a1-46b9-8da1-9e23f1c5e84e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:21.695000 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-deefca91-86a1-46b9-8da1-9e23f1c5e84e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:21.695425 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-deefca91-86a1-46b9-8da1-9e23f1c5e84e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:21.820130 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-deefca91-86a1-46b9-8da1-9e23f1c5e84e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:21.827769 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-deefca91-86a1-46b9-8da1-9e23f1c5e84e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1313 microversion: 2.1 time: 0.149137 Sep 17 21:16:21.828288 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 559/1087] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:21 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:22.850416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-05db270c-1ac3-4431-a572-1f1738675660 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:22.851025 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-05db270c-1ac3-4431-a572-1f1738675660 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:22.853384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:22.854151 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:22.860427 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05db270c-1ac3-4431-a572-1f1738675660 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:22.860933 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05db270c-1ac3-4431-a572-1f1738675660 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:22.861362 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05db270c-1ac3-4431-a572-1f1738675660 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:22.862050 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05db270c-1ac3-4431-a572-1f1738675660 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:22.862495 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05db270c-1ac3-4431-a572-1f1738675660 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:22.862911 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05db270c-1ac3-4431-a572-1f1738675660 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:22.877242 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c0c7134a-9038-461b-92cf-bc4ea7e9b9e7 req-56e98a46-829b-46d4-92e8-3f13bfaa1f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aadebbd0-1e96-47aa-89b3-7202bea1ad3f", "name": "network-vif-plugged", "status": "completed", "tag": "bb75961b-d562-4322-a7ad-a6ff6aa97716"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:22.887873 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c0c7134a-9038-461b-92cf-bc4ea7e9b9e7 req-56e98a46-829b-46d4-92e8-3f13bfaa1f2d service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:22.888206 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c0c7134a-9038-461b-92cf-bc4ea7e9b9e7 req-56e98a46-829b-46d4-92e8-3f13bfaa1f2d service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:22.888636 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c0c7134a-9038-461b-92cf-bc4ea7e9b9e7 req-56e98a46-829b-46d4-92e8-3f13bfaa1f2d service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:22.902440 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c0c7134a-9038-461b-92cf-bc4ea7e9b9e7 req-56e98a46-829b-46d4-92e8-3f13bfaa1f2d service nova] Creating event network-vif-plugged:bb75961b-d562-4322-a7ad-a6ff6aa97716 for instance aadebbd0-1e96-47aa-89b3-7202bea1ad3f on hv-cinder-82651 Sep 17 21:16:22.907567 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c0c7134a-9038-461b-92cf-bc4ea7e9b9e7 req-56e98a46-829b-46d4-92e8-3f13bfaa1f2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034642 Sep 17 21:16:22.908358 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 560/1088] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:16:23.015379 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-05db270c-1ac3-4431-a572-1f1738675660 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:23.024442 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-05db270c-1ac3-4431-a572-1f1738675660 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1313 microversion: 2.1 time: 0.177890 Sep 17 21:16:23.025036 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 529/1089] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:22 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:24.049910 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0cd6b22-360d-4846-a531-74cb0562f260 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:24.050520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0cd6b22-360d-4846-a531-74cb0562f260 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:24.056834 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0cd6b22-360d-4846-a531-74cb0562f260 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:24.057317 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0cd6b22-360d-4846-a531-74cb0562f260 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:24.057753 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0cd6b22-360d-4846-a531-74cb0562f260 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:24.058450 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0cd6b22-360d-4846-a531-74cb0562f260 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:24.058904 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0cd6b22-360d-4846-a531-74cb0562f260 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:24.059327 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0cd6b22-360d-4846-a531-74cb0562f260 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:24.192257 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0cd6b22-360d-4846-a531-74cb0562f260 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:24.200366 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0cd6b22-360d-4846-a531-74cb0562f260 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1313 microversion: 2.1 time: 0.155913 Sep 17 21:16:24.201063 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 561/1090] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:24 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:24.586285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc6ab743-05f7-4ad6-9568-1028906e3838 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e03b3ea7-5d84-4eac-8b26-5ddbc58961f2", "device": "/dev/sdb"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:24.589386 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc6ab743-05f7-4ad6-9568-1028906e3838 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:24.596149 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6ab743-05f7-4ad6-9568-1028906e3838 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:24.596629 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6ab743-05f7-4ad6-9568-1028906e3838 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:24.597085 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6ab743-05f7-4ad6-9568-1028906e3838 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:24.597771 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6ab743-05f7-4ad6-9568-1028906e3838 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:24.598221 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6ab743-05f7-4ad6-9568-1028906e3838 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:24.598640 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6ab743-05f7-4ad6-9568-1028906e3838 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:25.147624 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc6ab743-05f7-4ad6-9568-1028906e3838 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "POST /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.564992 Sep 17 21:16:25.148243 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 530/1091] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:16:24 2022] POST /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:25.227269 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-36ced6ca-be16-4ff7-a965-ce5e6383cd18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:25.227960 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-36ced6ca-be16-4ff7-a965-ce5e6383cd18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:25.235573 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36ced6ca-be16-4ff7-a965-ce5e6383cd18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:25.236167 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36ced6ca-be16-4ff7-a965-ce5e6383cd18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:25.236703 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36ced6ca-be16-4ff7-a965-ce5e6383cd18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:25.237481 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36ced6ca-be16-4ff7-a965-ce5e6383cd18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:25.238009 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36ced6ca-be16-4ff7-a965-ce5e6383cd18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:25.238442 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36ced6ca-be16-4ff7-a965-ce5e6383cd18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:25.376291 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-36ced6ca-be16-4ff7-a965-ce5e6383cd18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:25.384319 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-36ced6ca-be16-4ff7-a965-ce5e6383cd18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1498 microversion: 2.1 time: 0.162432 Sep 17 21:16:25.385145 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 562/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:25 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:25.850595 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-384ef061-61d4-4b5d-b26f-ecadecc49ba5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:25.851286 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-384ef061-61d4-4b5d-b26f-ecadecc49ba5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:25.857654 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-384ef061-61d4-4b5d-b26f-ecadecc49ba5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:25.858215 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-384ef061-61d4-4b5d-b26f-ecadecc49ba5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:25.859289 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-384ef061-61d4-4b5d-b26f-ecadecc49ba5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:25.860385 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-384ef061-61d4-4b5d-b26f-ecadecc49ba5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:25.860959 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-384ef061-61d4-4b5d-b26f-ecadecc49ba5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:25.861388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-384ef061-61d4-4b5d-b26f-ecadecc49ba5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:25.887229 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-384ef061-61d4-4b5d-b26f-ecadecc49ba5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:16:25.962233 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-384ef061-61d4-4b5d-b26f-ecadecc49ba5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 204 len: 0 microversion: 2.1 time: 0.116113 Sep 17 21:16:25.962980 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 531/1093] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:16:25 2022] DELETE /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:16:25.971260 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6ca2ad33-fbc4-4e21-aba3-14068422284c tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:25.971892 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ca2ad33-fbc4-4e21-aba3-14068422284c tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:25.977685 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ca2ad33-fbc4-4e21-aba3-14068422284c tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:25.978166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ca2ad33-fbc4-4e21-aba3-14068422284c tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:25.978626 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ca2ad33-fbc4-4e21-aba3-14068422284c tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:25.979309 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ca2ad33-fbc4-4e21-aba3-14068422284c tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:25.979760 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ca2ad33-fbc4-4e21-aba3-14068422284c tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:25.980181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ca2ad33-fbc4-4e21-aba3-14068422284c tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:26.111033 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ca2ad33-fbc4-4e21-aba3-14068422284c tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:26.118720 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6ca2ad33-fbc4-4e21-aba3-14068422284c tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1504 microversion: 2.1 time: 0.151313 Sep 17 21:16:26.119296 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 563/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:25 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:27.143498 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a4dc7b7e-1163-4e43-ad72-6b843bd4e171 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:27.144185 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a4dc7b7e-1163-4e43-ad72-6b843bd4e171 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:27.150559 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4dc7b7e-1163-4e43-ad72-6b843bd4e171 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:27.151041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4dc7b7e-1163-4e43-ad72-6b843bd4e171 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:27.151471 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4dc7b7e-1163-4e43-ad72-6b843bd4e171 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:27.152157 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4dc7b7e-1163-4e43-ad72-6b843bd4e171 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:27.152607 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4dc7b7e-1163-4e43-ad72-6b843bd4e171 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:27.153052 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4dc7b7e-1163-4e43-ad72-6b843bd4e171 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:27.283852 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a4dc7b7e-1163-4e43-ad72-6b843bd4e171 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:27.291625 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a4dc7b7e-1163-4e43-ad72-6b843bd4e171 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1504 microversion: 2.1 time: 0.153069 Sep 17 21:16:27.292389 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 532/1095] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:27 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:28.009335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-21e1b3d0-f6c3-4851-971d-d3bf3c0c1a71 req-3ed382fc-94dd-4289-b783-4327b217b05e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aadebbd0-1e96-47aa-89b3-7202bea1ad3f", "name": "network-vif-deleted", "tag": "bb75961b-d562-4322-a7ad-a6ff6aa97716"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:28.020532 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-21e1b3d0-f6c3-4851-971d-d3bf3c0c1a71 req-3ed382fc-94dd-4289-b783-4327b217b05e service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:28.021040 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-21e1b3d0-f6c3-4851-971d-d3bf3c0c1a71 req-3ed382fc-94dd-4289-b783-4327b217b05e service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:28.021613 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-21e1b3d0-f6c3-4851-971d-d3bf3c0c1a71 req-3ed382fc-94dd-4289-b783-4327b217b05e service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:28.035649 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-21e1b3d0-f6c3-4851-971d-d3bf3c0c1a71 req-3ed382fc-94dd-4289-b783-4327b217b05e service nova] Creating event network-vif-deleted:bb75961b-d562-4322-a7ad-a6ff6aa97716 for instance aadebbd0-1e96-47aa-89b3-7202bea1ad3f on hv-cinder-82651 Sep 17 21:16:28.041278 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-21e1b3d0-f6c3-4851-971d-d3bf3c0c1a71 req-3ed382fc-94dd-4289-b783-4327b217b05e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035099 Sep 17 21:16:28.042273 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 564/1096] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:28.315636 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:28.316235 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:28.322608 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:28.323084 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:28.323512 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:28.324219 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:28.324666 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:28.325103 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:28.357515 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:28.358000 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:28.358429 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:28.359511 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lazy-loading 'fault' on Instance uuid aadebbd0-1e96-47aa-89b3-7202bea1ad3f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:16:28.399658 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:28.407941 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-97761050-8c87-4700-a973-3a2d2ff82f41 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 200 len: 1303 microversion: 2.1 time: 0.096476 Sep 17 21:16:28.408507 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 533/1097] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:28 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:29.431903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3a0c586-2df7-43a7-822f-00aea10dec3b tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:29.432463 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d3a0c586-2df7-43a7-822f-00aea10dec3b tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: aadebbd0-1e96-47aa-89b3-7202bea1ad3f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:29.439427 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a0c586-2df7-43a7-822f-00aea10dec3b tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:29.439908 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a0c586-2df7-43a7-822f-00aea10dec3b tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:29.440347 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a0c586-2df7-43a7-822f-00aea10dec3b tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:29.441927 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a0c586-2df7-43a7-822f-00aea10dec3b tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:29.442385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a0c586-2df7-43a7-822f-00aea10dec3b tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:29.442929 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a0c586-2df7-43a7-822f-00aea10dec3b tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:29.456626 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d3a0c586-2df7-43a7-822f-00aea10dec3b tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] HTTP exception thrown: Instance aadebbd0-1e96-47aa-89b3-7202bea1ad3f could not be found. Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3a0c586-2df7-43a7-822f-00aea10dec3b tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Request method failure captured: Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f HTTP/1.1 Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjkYK07R-TdBtdfMGsCmLEW8MlrIoBEQdOFN_xGUiLC5nU8zgsTi42lGLymfz6JdNxLaCUgTbNCwg3ouQjKYSIZAkktI0rt6BnPg2lWjYF49vLEz9l3RlTkwaDd7wyjIVmkKaOwvqS-buNo1rV4wKlemQP8bJBHCvGq5Eyyth8q_U-w Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: 66a629d38940403aa7ee49b68f1d8ecf Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesActionsTest-718686079 Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:16:29.458285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:16:29.459993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/66a629d38940403aa7ee49b68f1d8ecf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66a629d38940403aa7ee49b68f1d8ecf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66a629d38940403aa7ee49b68f1d8ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_66a629d38940403aa7ee49b68f1d8ecf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:16:29.459993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesActionsTest-718686079 Sep 17 21:16:29.459993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 66a629d38940403aa7ee49b68f1d8ecf Sep 17 21:16:29.459993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesActionsTest-718686079 Sep 17 21:16:29.459993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesActionsTest-718686079-project Sep 17 21:16:29.459993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:16:29.459993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:16:29.459993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 21a22c69a4e54c7896fa8e745d1dfc38 Sep 17 21:16:29.459993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesActionsTest-718686079-project Sep 17 21:16:29.459993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:16:29.459993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance aadebbd0-1e96-47aa-89b3-7202bea1ad3f could not be found. Sep 17 21:16:29.459993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': 'aadebbd0-1e96-47aa-89b3-7202bea1ad3f'} Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aadebbd0-1e96-47aa-89b3-7202bea1ad3f could not be found. Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:16:29.461209 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aadebbd0-1e96-47aa-89b3-7202bea1ad3f could not be found. Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aadebbd0-1e96-47aa-89b3-7202bea1ad3f could not be found. Sep 17 21:16:29.462839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:29.464332 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3a0c586-2df7-43a7-822f-00aea10dec3b tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Returning 404 to user: Instance aadebbd0-1e96-47aa-89b3-7202bea1ad3f could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:16:29.464332 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3a0c586-2df7-43a7-822f-00aea10dec3b tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f" status: 404 len: 111 microversion: 2.1 time: 0.032037 Sep 17 21:16:29.464332 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 565/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:29 2022] GET /compute/v2.1/servers/aadebbd0-1e96-47aa-89b3-7202bea1ad3f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:16:29.509887 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1989133344", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "networks": [{"uuid": "79573bf9-f27c-4dbb-bc1a-839c0147cc1b"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:29.563550 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] validate_networks() for [('79573bf9-f27c-4dbb-bc1a-839c0147cc1b', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:16:29.952223 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:16:29.953257 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:16:29.953753 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:16:29.954150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:16:29.954556 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:16:29.963126 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:29.963604 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:29.964032 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:29.964787 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:29.965241 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:29.965660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:29.982462 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Getting quotas for project 66a629d38940403aa7ee49b68f1d8ecf. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:16:29.986484 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Getting quotas for user 21a22c69a4e54c7896fa8e745d1dfc38 and project 66a629d38940403aa7ee49b68f1d8ecf. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:16:29.997173 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:16:30.000086 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:16:30.051787 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4db41ea8-4a25-4f2f-8489-141944f8e7a3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546018 Sep 17 21:16:30.052444 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 534/1099] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:16:30.064533 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7857a209-0b2a-4553-ba9e-bf8173e87060 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:30.065179 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7857a209-0b2a-4553-ba9e-bf8173e87060 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:30.123517 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7857a209-0b2a-4553-ba9e-bf8173e87060 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:30.131229 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7857a209-0b2a-4553-ba9e-bf8173e87060 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1214 microversion: 2.1 time: 0.071624 Sep 17 21:16:30.131869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 566/1100] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:30 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:31.156380 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2a65e9ee-20df-4bc9-b96a-dbcdf46c7a26 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:31.156937 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2a65e9ee-20df-4bc9-b96a-dbcdf46c7a26 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:31.162969 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a65e9ee-20df-4bc9-b96a-dbcdf46c7a26 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:31.163452 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a65e9ee-20df-4bc9-b96a-dbcdf46c7a26 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:31.163886 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a65e9ee-20df-4bc9-b96a-dbcdf46c7a26 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:31.164577 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a65e9ee-20df-4bc9-b96a-dbcdf46c7a26 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:31.165058 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a65e9ee-20df-4bc9-b96a-dbcdf46c7a26 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:31.165485 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a65e9ee-20df-4bc9-b96a-dbcdf46c7a26 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:31.228626 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a65e9ee-20df-4bc9-b96a-dbcdf46c7a26 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:31.236498 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2a65e9ee-20df-4bc9-b96a-dbcdf46c7a26 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1266 microversion: 2.1 time: 0.085214 Sep 17 21:16:31.237167 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 535/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:31 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:32.259492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9107ce2d-c7a1-47f5-adfe-a482fdce3aac tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:32.260280 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9107ce2d-c7a1-47f5-adfe-a482fdce3aac tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:32.270836 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9107ce2d-c7a1-47f5-adfe-a482fdce3aac tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:32.271317 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9107ce2d-c7a1-47f5-adfe-a482fdce3aac tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:32.271915 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9107ce2d-c7a1-47f5-adfe-a482fdce3aac tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:32.272637 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9107ce2d-c7a1-47f5-adfe-a482fdce3aac tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:32.273128 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9107ce2d-c7a1-47f5-adfe-a482fdce3aac tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:32.273574 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9107ce2d-c7a1-47f5-adfe-a482fdce3aac tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:32.337850 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-9107ce2d-c7a1-47f5-adfe-a482fdce3aac tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:32.349413 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9107ce2d-c7a1-47f5-adfe-a482fdce3aac tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1272 microversion: 2.1 time: 0.093346 Sep 17 21:16:32.350341 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 567/1102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:32 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:33.151167 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-710d9d4b-eb49-486a-a0db-c3c4cd8836f2 req-480de704-9827-4ed4-a3f9-a4708475b350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a669608-0a73-401a-9ea8-5c989444c961", "tag": "1b1338c7-e66d-4091-a6db-558dc699eba0"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:33.162584 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-710d9d4b-eb49-486a-a0db-c3c4cd8836f2 req-480de704-9827-4ed4-a3f9-a4708475b350 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:33.163064 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-710d9d4b-eb49-486a-a0db-c3c4cd8836f2 req-480de704-9827-4ed4-a3f9-a4708475b350 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:33.163524 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-710d9d4b-eb49-486a-a0db-c3c4cd8836f2 req-480de704-9827-4ed4-a3f9-a4708475b350 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:33.177192 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-710d9d4b-eb49-486a-a0db-c3c4cd8836f2 req-480de704-9827-4ed4-a3f9-a4708475b350 service nova] Creating event network-changed:1b1338c7-e66d-4091-a6db-558dc699eba0 for instance 1a669608-0a73-401a-9ea8-5c989444c961 on hv-cinder-82651 Sep 17 21:16:33.181734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-710d9d4b-eb49-486a-a0db-c3c4cd8836f2 req-480de704-9827-4ed4-a3f9-a4708475b350 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034366 Sep 17 21:16:33.182659 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 536/1103] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:33.378385 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3b2955f-0220-4a35-8ab0-a776d859975a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:33.379003 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d3b2955f-0220-4a35-8ab0-a776d859975a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:33.386182 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3b2955f-0220-4a35-8ab0-a776d859975a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:33.386671 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3b2955f-0220-4a35-8ab0-a776d859975a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:33.387110 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3b2955f-0220-4a35-8ab0-a776d859975a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:33.387824 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3b2955f-0220-4a35-8ab0-a776d859975a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:33.388287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3b2955f-0220-4a35-8ab0-a776d859975a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:33.388730 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3b2955f-0220-4a35-8ab0-a776d859975a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:33.520086 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d3b2955f-0220-4a35-8ab0-a776d859975a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:33.527679 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3b2955f-0220-4a35-8ab0-a776d859975a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.153876 Sep 17 21:16:33.528281 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 568/1104] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:33 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:34.552482 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-932c553b-6f61-4474-9d8a-1217f0d06de3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:34.553192 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-932c553b-6f61-4474-9d8a-1217f0d06de3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:34.559295 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932c553b-6f61-4474-9d8a-1217f0d06de3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:34.559770 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932c553b-6f61-4474-9d8a-1217f0d06de3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:34.560198 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932c553b-6f61-4474-9d8a-1217f0d06de3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:34.560909 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932c553b-6f61-4474-9d8a-1217f0d06de3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:34.561360 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932c553b-6f61-4474-9d8a-1217f0d06de3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:34.561776 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932c553b-6f61-4474-9d8a-1217f0d06de3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:34.701196 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-932c553b-6f61-4474-9d8a-1217f0d06de3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:34.709351 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-932c553b-6f61-4474-9d8a-1217f0d06de3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.162215 Sep 17 21:16:34.709913 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 537/1105] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:34 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:35.731956 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10e177ec-76d9-4cdf-bf74-b4aae7ef00e9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:35.732559 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-10e177ec-76d9-4cdf-bf74-b4aae7ef00e9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:35.739073 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10e177ec-76d9-4cdf-bf74-b4aae7ef00e9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:35.739548 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10e177ec-76d9-4cdf-bf74-b4aae7ef00e9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:35.739981 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10e177ec-76d9-4cdf-bf74-b4aae7ef00e9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:35.740665 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10e177ec-76d9-4cdf-bf74-b4aae7ef00e9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:35.741147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10e177ec-76d9-4cdf-bf74-b4aae7ef00e9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:35.741566 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10e177ec-76d9-4cdf-bf74-b4aae7ef00e9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:35.868438 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-10e177ec-76d9-4cdf-bf74-b4aae7ef00e9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:35.876691 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-10e177ec-76d9-4cdf-bf74-b4aae7ef00e9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.148520 Sep 17 21:16:35.877258 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 569/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:35 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:36.899351 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eaf3ad1e-7cb5-4391-a3c7-a72d19111abb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:36.900003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eaf3ad1e-7cb5-4391-a3c7-a72d19111abb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:36.906356 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaf3ad1e-7cb5-4391-a3c7-a72d19111abb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:36.907426 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaf3ad1e-7cb5-4391-a3c7-a72d19111abb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:36.907922 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaf3ad1e-7cb5-4391-a3c7-a72d19111abb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:36.908975 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaf3ad1e-7cb5-4391-a3c7-a72d19111abb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:36.909428 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaf3ad1e-7cb5-4391-a3c7-a72d19111abb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:36.909850 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaf3ad1e-7cb5-4391-a3c7-a72d19111abb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:37.041657 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-eaf3ad1e-7cb5-4391-a3c7-a72d19111abb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:37.049767 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eaf3ad1e-7cb5-4391-a3c7-a72d19111abb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.154202 Sep 17 21:16:37.050324 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 538/1107] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:36 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:38.072505 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a4e369e7-1923-46cd-919b-f8b43b91ecf3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:38.073158 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a4e369e7-1923-46cd-919b-f8b43b91ecf3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:38.079990 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4e369e7-1923-46cd-919b-f8b43b91ecf3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:38.080473 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4e369e7-1923-46cd-919b-f8b43b91ecf3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:38.080955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4e369e7-1923-46cd-919b-f8b43b91ecf3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:38.081631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4e369e7-1923-46cd-919b-f8b43b91ecf3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:38.082087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4e369e7-1923-46cd-919b-f8b43b91ecf3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:38.082514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4e369e7-1923-46cd-919b-f8b43b91ecf3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:38.238945 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a4e369e7-1923-46cd-919b-f8b43b91ecf3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:38.246729 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a4e369e7-1923-46cd-919b-f8b43b91ecf3 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.178006 Sep 17 21:16:38.247220 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 570/1108] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:38 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:39.271035 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4720875b-9d88-45f1-8e19-0b769e0d22fb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:39.271639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4720875b-9d88-45f1-8e19-0b769e0d22fb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:39.278057 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4720875b-9d88-45f1-8e19-0b769e0d22fb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:39.278532 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4720875b-9d88-45f1-8e19-0b769e0d22fb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:39.278962 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4720875b-9d88-45f1-8e19-0b769e0d22fb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:39.279637 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4720875b-9d88-45f1-8e19-0b769e0d22fb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:39.280083 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4720875b-9d88-45f1-8e19-0b769e0d22fb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:39.280499 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4720875b-9d88-45f1-8e19-0b769e0d22fb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:39.410211 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4720875b-9d88-45f1-8e19-0b769e0d22fb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:39.417757 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4720875b-9d88-45f1-8e19-0b769e0d22fb tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.150740 Sep 17 21:16:39.418333 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 539/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:39 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:40.441490 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1641cda4-cac0-44e7-a9a8-8ba1aecaa68f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:40.442100 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1641cda4-cac0-44e7-a9a8-8ba1aecaa68f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:40.444464 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:40.449762 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1641cda4-cac0-44e7-a9a8-8ba1aecaa68f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:40.450249 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1641cda4-cac0-44e7-a9a8-8ba1aecaa68f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:40.450684 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1641cda4-cac0-44e7-a9a8-8ba1aecaa68f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:40.451375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1641cda4-cac0-44e7-a9a8-8ba1aecaa68f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:40.451831 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1641cda4-cac0-44e7-a9a8-8ba1aecaa68f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:40.452257 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1641cda4-cac0-44e7-a9a8-8ba1aecaa68f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:40.581411 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1641cda4-cac0-44e7-a9a8-8ba1aecaa68f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:40.589061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1641cda4-cac0-44e7-a9a8-8ba1aecaa68f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.151699 Sep 17 21:16:40.589623 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 571/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:40 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:41.612586 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34adfe6b-04d8-44ac-8f18-8f04ab4a4c18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:41.613163 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-34adfe6b-04d8-44ac-8f18-8f04ab4a4c18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:41.614995 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:41.615642 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:41.621759 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34adfe6b-04d8-44ac-8f18-8f04ab4a4c18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:41.622240 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34adfe6b-04d8-44ac-8f18-8f04ab4a4c18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:41.622672 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34adfe6b-04d8-44ac-8f18-8f04ab4a4c18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:41.623355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34adfe6b-04d8-44ac-8f18-8f04ab4a4c18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:41.623803 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34adfe6b-04d8-44ac-8f18-8f04ab4a4c18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:41.624221 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34adfe6b-04d8-44ac-8f18-8f04ab4a4c18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:41.747972 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-34adfe6b-04d8-44ac-8f18-8f04ab4a4c18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:41.750147 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:41.757192 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-34adfe6b-04d8-44ac-8f18-8f04ab4a4c18 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.149046 Sep 17 21:16:41.757747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 540/1111] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:41 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:42.174553 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc15bf83-ee8c-46da-8a8c-d9c16220c03c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:42.175048 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc15bf83-ee8c-46da-8a8c-d9c16220c03c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:42.181494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc15bf83-ee8c-46da-8a8c-d9c16220c03c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:42.181975 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc15bf83-ee8c-46da-8a8c-d9c16220c03c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:42.182407 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc15bf83-ee8c-46da-8a8c-d9c16220c03c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:42.183095 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc15bf83-ee8c-46da-8a8c-d9c16220c03c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:42.183551 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc15bf83-ee8c-46da-8a8c-d9c16220c03c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:42.183972 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc15bf83-ee8c-46da-8a8c-d9c16220c03c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:42.210858 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc15bf83-ee8c-46da-8a8c-d9c16220c03c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:16:42.285766 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc15bf83-ee8c-46da-8a8c-d9c16220c03c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 204 len: 0 microversion: 2.1 time: 0.114932 Sep 17 21:16:42.286245 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 572/1112] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:16:42 2022] DELETE /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:16:42.294416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e0f760c2-6539-4116-9390-f51438a149cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:42.295038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e0f760c2-6539-4116-9390-f51438a149cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:42.302541 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0f760c2-6539-4116-9390-f51438a149cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:42.306854 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0f760c2-6539-4116-9390-f51438a149cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:42.307786 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0f760c2-6539-4116-9390-f51438a149cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:42.308505 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0f760c2-6539-4116-9390-f51438a149cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:42.308997 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0f760c2-6539-4116-9390-f51438a149cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:42.309418 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0f760c2-6539-4116-9390-f51438a149cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:42.446141 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e0f760c2-6539-4116-9390-f51438a149cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:42.454321 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e0f760c2-6539-4116-9390-f51438a149cb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1575 microversion: 2.1 time: 0.163844 Sep 17 21:16:42.454884 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 541/1113] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:42 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:42.780849 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4efe5c16-24af-4dee-bb44-982606d8522f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:42.781554 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4efe5c16-24af-4dee-bb44-982606d8522f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:42.787572 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4efe5c16-24af-4dee-bb44-982606d8522f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:42.788071 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4efe5c16-24af-4dee-bb44-982606d8522f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:42.788494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4efe5c16-24af-4dee-bb44-982606d8522f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:42.789212 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4efe5c16-24af-4dee-bb44-982606d8522f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:42.789667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4efe5c16-24af-4dee-bb44-982606d8522f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:42.790090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4efe5c16-24af-4dee-bb44-982606d8522f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:42.915689 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4efe5c16-24af-4dee-bb44-982606d8522f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:42.924076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4efe5c16-24af-4dee-bb44-982606d8522f tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.147601 Sep 17 21:16:42.924629 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 573/1114] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:42 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:43.478095 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-982a4871-71f7-4ac9-99fb-2207bc9f37ea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:43.478700 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-982a4871-71f7-4ac9-99fb-2207bc9f37ea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:43.502385 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982a4871-71f7-4ac9-99fb-2207bc9f37ea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:43.502888 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982a4871-71f7-4ac9-99fb-2207bc9f37ea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:43.503327 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982a4871-71f7-4ac9-99fb-2207bc9f37ea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:43.504032 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982a4871-71f7-4ac9-99fb-2207bc9f37ea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:43.504483 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982a4871-71f7-4ac9-99fb-2207bc9f37ea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:43.504929 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982a4871-71f7-4ac9-99fb-2207bc9f37ea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:43.639343 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-982a4871-71f7-4ac9-99fb-2207bc9f37ea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:43.647644 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-982a4871-71f7-4ac9-99fb-2207bc9f37ea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1575 microversion: 2.1 time: 0.173374 Sep 17 21:16:43.648207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 542/1115] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:43 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:43.947266 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f39b1be-caf7-4476-b9b8-0a30d737260e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:43.947885 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f39b1be-caf7-4476-b9b8-0a30d737260e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:43.954815 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f39b1be-caf7-4476-b9b8-0a30d737260e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:43.955295 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f39b1be-caf7-4476-b9b8-0a30d737260e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:43.955731 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f39b1be-caf7-4476-b9b8-0a30d737260e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:43.956425 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f39b1be-caf7-4476-b9b8-0a30d737260e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:43.956920 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f39b1be-caf7-4476-b9b8-0a30d737260e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:43.957348 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f39b1be-caf7-4476-b9b8-0a30d737260e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:44.084834 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f39b1be-caf7-4476-b9b8-0a30d737260e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:44.092405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f39b1be-caf7-4476-b9b8-0a30d737260e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.149006 Sep 17 21:16:44.092996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 574/1116] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:43 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:44.670416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5a5588e1-49e9-4e29-9f32-aa358bcc5902 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:44.670945 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5a5588e1-49e9-4e29-9f32-aa358bcc5902 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:44.677843 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a5588e1-49e9-4e29-9f32-aa358bcc5902 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:44.678320 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a5588e1-49e9-4e29-9f32-aa358bcc5902 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:44.678750 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a5588e1-49e9-4e29-9f32-aa358bcc5902 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:44.679430 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a5588e1-49e9-4e29-9f32-aa358bcc5902 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:44.679879 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a5588e1-49e9-4e29-9f32-aa358bcc5902 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:44.680294 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a5588e1-49e9-4e29-9f32-aa358bcc5902 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:44.807528 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5a5588e1-49e9-4e29-9f32-aa358bcc5902 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:44.815416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5a5588e1-49e9-4e29-9f32-aa358bcc5902 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1575 microversion: 2.1 time: 0.148888 Sep 17 21:16:44.815971 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 543/1117] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:44 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:45.116285 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c8b2aa0-eb2c-461b-98d9-3a5b364daa03 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:45.116916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8c8b2aa0-eb2c-461b-98d9-3a5b364daa03 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:45.123359 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c8b2aa0-eb2c-461b-98d9-3a5b364daa03 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:45.123843 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c8b2aa0-eb2c-461b-98d9-3a5b364daa03 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:45.124271 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c8b2aa0-eb2c-461b-98d9-3a5b364daa03 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:45.125024 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c8b2aa0-eb2c-461b-98d9-3a5b364daa03 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:45.125476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c8b2aa0-eb2c-461b-98d9-3a5b364daa03 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:45.125893 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c8b2aa0-eb2c-461b-98d9-3a5b364daa03 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:45.255265 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8c8b2aa0-eb2c-461b-98d9-3a5b364daa03 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:45.262985 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8c8b2aa0-eb2c-461b-98d9-3a5b364daa03 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.150515 Sep 17 21:16:45.263544 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 575/1118] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:45 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:45.839353 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-496427a5-5cde-4a38-9390-e85ee5501319 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:45.840232 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-496427a5-5cde-4a38-9390-e85ee5501319 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:45.847646 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-496427a5-5cde-4a38-9390-e85ee5501319 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:45.848130 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-496427a5-5cde-4a38-9390-e85ee5501319 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:45.848560 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-496427a5-5cde-4a38-9390-e85ee5501319 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:45.849283 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-496427a5-5cde-4a38-9390-e85ee5501319 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:45.849739 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-496427a5-5cde-4a38-9390-e85ee5501319 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:45.850164 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-496427a5-5cde-4a38-9390-e85ee5501319 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:45.979188 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-496427a5-5cde-4a38-9390-e85ee5501319 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:45.987075 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-496427a5-5cde-4a38-9390-e85ee5501319 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1575 microversion: 2.1 time: 0.152545 Sep 17 21:16:45.987777 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 544/1119] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:45 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:46.287416 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40da5135-46d6-470e-8d49-d8659b0b49af tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:46.288025 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-40da5135-46d6-470e-8d49-d8659b0b49af tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:46.294235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40da5135-46d6-470e-8d49-d8659b0b49af tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:46.294715 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40da5135-46d6-470e-8d49-d8659b0b49af tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:46.295145 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40da5135-46d6-470e-8d49-d8659b0b49af tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:46.295839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40da5135-46d6-470e-8d49-d8659b0b49af tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:46.296287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40da5135-46d6-470e-8d49-d8659b0b49af tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:46.296726 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40da5135-46d6-470e-8d49-d8659b0b49af tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:46.299538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:46.435103 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-40da5135-46d6-470e-8d49-d8659b0b49af tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:46.444038 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-40da5135-46d6-470e-8d49-d8659b0b49af tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.160552 Sep 17 21:16:46.444595 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 576/1120] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:46 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:47.010084 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-68cd60fd-d428-4075-953f-5a19047d7a43 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:47.010732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-68cd60fd-d428-4075-953f-5a19047d7a43 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:47.017690 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68cd60fd-d428-4075-953f-5a19047d7a43 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:47.018176 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68cd60fd-d428-4075-953f-5a19047d7a43 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:47.018640 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68cd60fd-d428-4075-953f-5a19047d7a43 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:47.019705 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68cd60fd-d428-4075-953f-5a19047d7a43 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:47.020170 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68cd60fd-d428-4075-953f-5a19047d7a43 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:47.022731 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68cd60fd-d428-4075-953f-5a19047d7a43 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:47.153181 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-68cd60fd-d428-4075-953f-5a19047d7a43 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:47.161613 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-68cd60fd-d428-4075-953f-5a19047d7a43 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1575 microversion: 2.1 time: 0.155490 Sep 17 21:16:47.162173 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 545/1121] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:47 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:47.467304 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25b18449-6996-4531-9df1-7ea7eccc4e4a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:47.467932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-25b18449-6996-4531-9df1-7ea7eccc4e4a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:47.475076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25b18449-6996-4531-9df1-7ea7eccc4e4a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:47.475546 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25b18449-6996-4531-9df1-7ea7eccc4e4a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:47.475972 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25b18449-6996-4531-9df1-7ea7eccc4e4a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:47.476650 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25b18449-6996-4531-9df1-7ea7eccc4e4a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:47.477118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25b18449-6996-4531-9df1-7ea7eccc4e4a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:47.477535 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25b18449-6996-4531-9df1-7ea7eccc4e4a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:47.622817 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-25b18449-6996-4531-9df1-7ea7eccc4e4a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:47.631172 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-25b18449-6996-4531-9df1-7ea7eccc4e4a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.167684 Sep 17 21:16:47.631720 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 577/1122] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:47 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:48.185157 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-beb82406-19a5-4465-a929-d245c2ff5eed tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:48.185800 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-beb82406-19a5-4465-a929-d245c2ff5eed tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:48.193171 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb82406-19a5-4465-a929-d245c2ff5eed tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:48.193654 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb82406-19a5-4465-a929-d245c2ff5eed tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:48.194083 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb82406-19a5-4465-a929-d245c2ff5eed tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:48.194768 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb82406-19a5-4465-a929-d245c2ff5eed tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:48.195222 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb82406-19a5-4465-a929-d245c2ff5eed tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:48.195643 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb82406-19a5-4465-a929-d245c2ff5eed tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:48.323755 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-beb82406-19a5-4465-a929-d245c2ff5eed tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:48.332331 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-beb82406-19a5-4465-a929-d245c2ff5eed tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1575 microversion: 2.1 time: 0.151012 Sep 17 21:16:48.332940 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 546/1123] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:48 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:48.662913 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c678b90e-276d-4812-b06d-d09bd7432aab tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:48.663540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c678b90e-276d-4812-b06d-d09bd7432aab tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:48.669774 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c678b90e-276d-4812-b06d-d09bd7432aab tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:48.670260 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c678b90e-276d-4812-b06d-d09bd7432aab tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:48.670694 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c678b90e-276d-4812-b06d-d09bd7432aab tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:48.671438 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c678b90e-276d-4812-b06d-d09bd7432aab tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:48.671896 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c678b90e-276d-4812-b06d-d09bd7432aab tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:48.672319 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c678b90e-276d-4812-b06d-d09bd7432aab tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:48.809455 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c678b90e-276d-4812-b06d-d09bd7432aab tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:48.817287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c678b90e-276d-4812-b06d-d09bd7432aab tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.159338 Sep 17 21:16:48.817845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 578/1124] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:48 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:49.357329 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2cb8b5bb-97eb-46a6-919d-0348da4b1cf9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:49.357941 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2cb8b5bb-97eb-46a6-919d-0348da4b1cf9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:49.365122 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cb8b5bb-97eb-46a6-919d-0348da4b1cf9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:49.365533 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cb8b5bb-97eb-46a6-919d-0348da4b1cf9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:49.365962 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cb8b5bb-97eb-46a6-919d-0348da4b1cf9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:49.366653 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cb8b5bb-97eb-46a6-919d-0348da4b1cf9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:49.367104 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cb8b5bb-97eb-46a6-919d-0348da4b1cf9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:49.367520 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cb8b5bb-97eb-46a6-919d-0348da4b1cf9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:49.677009 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-68a2204a-97c9-4b0b-8a40-621b17da3068 req-71533078-cefe-4fe8-8b97-1478735e0dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a669608-0a73-401a-9ea8-5c989444c961", "name": "network-vif-plugged", "status": "completed", "tag": "1b1338c7-e66d-4091-a6db-558dc699eba0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:49.687826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-68a2204a-97c9-4b0b-8a40-621b17da3068 req-71533078-cefe-4fe8-8b97-1478735e0dac service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:49.688358 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-68a2204a-97c9-4b0b-8a40-621b17da3068 req-71533078-cefe-4fe8-8b97-1478735e0dac service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:49.688845 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-68a2204a-97c9-4b0b-8a40-621b17da3068 req-71533078-cefe-4fe8-8b97-1478735e0dac service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:49.703052 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-68a2204a-97c9-4b0b-8a40-621b17da3068 req-71533078-cefe-4fe8-8b97-1478735e0dac service nova] Creating event network-vif-plugged:1b1338c7-e66d-4091-a6db-558dc699eba0 for instance 1a669608-0a73-401a-9ea8-5c989444c961 on hv-cinder-82651 Sep 17 21:16:49.708435 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-68a2204a-97c9-4b0b-8a40-621b17da3068 req-71533078-cefe-4fe8-8b97-1478735e0dac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036202 Sep 17 21:16:49.709264 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 579/1125] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:16:49.847574 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b11dc493-fd52-4946-a502-e4fff198a25e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:49.851075 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b11dc493-fd52-4946-a502-e4fff198a25e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:49.862858 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11dc493-fd52-4946-a502-e4fff198a25e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:49.863595 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11dc493-fd52-4946-a502-e4fff198a25e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:49.863913 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11dc493-fd52-4946-a502-e4fff198a25e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:49.864631 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11dc493-fd52-4946-a502-e4fff198a25e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:49.865106 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11dc493-fd52-4946-a502-e4fff198a25e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:49.865593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11dc493-fd52-4946-a502-e4fff198a25e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:49.870478 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2cb8b5bb-97eb-46a6-919d-0348da4b1cf9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:49.878281 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2cb8b5bb-97eb-46a6-919d-0348da4b1cf9 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1575 microversion: 2.1 time: 0.524649 Sep 17 21:16:49.879843 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 547/1126] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:49 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1575 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:50.097313 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b11dc493-fd52-4946-a502-e4fff198a25e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:50.105055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b11dc493-fd52-4946-a502-e4fff198a25e tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.268340 Sep 17 21:16:50.105827 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 580/1127] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:49 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:50.660314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-61da5332-f333-4863-bb3f-8f4c7883abb6 req-563fd58e-b535-488f-a991-7dc39407b1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c20c116-f378-4a7e-812b-45a6824e98ad", "name": "network-vif-deleted", "tag": "4c335199-6467-42cd-bd0e-cd87c9b1dac8"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:50.670126 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-61da5332-f333-4863-bb3f-8f4c7883abb6 req-563fd58e-b535-488f-a991-7dc39407b1eb service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:50.670693 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-61da5332-f333-4863-bb3f-8f4c7883abb6 req-563fd58e-b535-488f-a991-7dc39407b1eb service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:50.671195 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-61da5332-f333-4863-bb3f-8f4c7883abb6 req-563fd58e-b535-488f-a991-7dc39407b1eb service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:50.682563 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-61da5332-f333-4863-bb3f-8f4c7883abb6 req-563fd58e-b535-488f-a991-7dc39407b1eb service nova] Creating event network-vif-deleted:4c335199-6467-42cd-bd0e-cd87c9b1dac8 for instance 0c20c116-f378-4a7e-812b-45a6824e98ad on hv-cinder-82651 Sep 17 21:16:50.687806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-61da5332-f333-4863-bb3f-8f4c7883abb6 req-563fd58e-b535-488f-a991-7dc39407b1eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031111 Sep 17 21:16:50.688656 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 548/1128] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:50.907003 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec657b6d-5887-4487-ba95-0ea45d90f897 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:50.907633 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec657b6d-5887-4487-ba95-0ea45d90f897 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:50.919830 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec657b6d-5887-4487-ba95-0ea45d90f897 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:50.925454 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec657b6d-5887-4487-ba95-0ea45d90f897 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:50.926195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec657b6d-5887-4487-ba95-0ea45d90f897 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:50.927031 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec657b6d-5887-4487-ba95-0ea45d90f897 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:50.927553 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec657b6d-5887-4487-ba95-0ea45d90f897 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:50.928099 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec657b6d-5887-4487-ba95-0ea45d90f897 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:51.005913 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ec657b6d-5887-4487-ba95-0ea45d90f897 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:51.013875 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec657b6d-5887-4487-ba95-0ea45d90f897 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1224 microversion: 2.1 time: 0.111486 Sep 17 21:16:51.014372 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 581/1129] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:50 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:51.129145 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-44d71891-88a2-461c-9732-7641e1c1c1d9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:51.129936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-44d71891-88a2-461c-9732-7641e1c1c1d9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:51.135972 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44d71891-88a2-461c-9732-7641e1c1c1d9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:51.136462 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44d71891-88a2-461c-9732-7641e1c1c1d9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:51.137056 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44d71891-88a2-461c-9732-7641e1c1c1d9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:51.137756 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44d71891-88a2-461c-9732-7641e1c1c1d9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:51.138209 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44d71891-88a2-461c-9732-7641e1c1c1d9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:51.138633 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44d71891-88a2-461c-9732-7641e1c1c1d9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:51.272438 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-44d71891-88a2-461c-9732-7641e1c1c1d9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:51.280007 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-44d71891-88a2-461c-9732-7641e1c1c1d9 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1314 microversion: 2.1 time: 0.155851 Sep 17 21:16:51.280561 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 549/1130] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:51 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:52.023649 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75b8b5a4-333d-4cd6-b44d-873f64446b0d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:52.024145 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75b8b5a4-333d-4cd6-b44d-873f64446b0d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:52.026536 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:52.032615 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75b8b5a4-333d-4cd6-b44d-873f64446b0d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:52.033324 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75b8b5a4-333d-4cd6-b44d-873f64446b0d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:52.033848 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75b8b5a4-333d-4cd6-b44d-873f64446b0d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:52.034556 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75b8b5a4-333d-4cd6-b44d-873f64446b0d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:52.035015 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75b8b5a4-333d-4cd6-b44d-873f64446b0d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:52.035441 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75b8b5a4-333d-4cd6-b44d-873f64446b0d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:52.037224 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:52.037830 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:52.044164 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:52.044639 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:52.045101 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:52.045781 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:52.046231 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:52.046649 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:52.080249 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:52.080759 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:52.081195 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:52.081642 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lazy-loading 'fault' on Instance uuid 0c20c116-f378-4a7e-812b-45a6824e98ad {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:16:52.125034 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-75b8b5a4-333d-4cd6-b44d-873f64446b0d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lazy-loading 'services' on Instance uuid e3c7c925-ef34-4794-86f0-6b405ae816e4 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:16:52.125211 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:52.138517 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ef79f436-1243-4134-8668-8b5a90a0f3ae tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 200 len: 1229 microversion: 2.1 time: 0.104814 Sep 17 21:16:52.139403 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 550/1131] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:52 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:52.212190 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75b8b5a4-333d-4cd6-b44d-873f64446b0d tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4/os-volume_attachments/e03b3ea7-5d84-4eac-8b26-5ddbc58961f2" status: 202 len: 0 microversion: 2.1 time: 0.192098 Sep 17 21:16:52.213085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 582/1132] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 17 21:16:52 2022] DELETE /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4/os-volume_attachments/e03b3ea7-5d84-4eac-8b26-5ddbc58961f2 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:16:52.303410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d3c0b094-6279-4b31-9f89-11a1474458b5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:52.304022 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d3c0b094-6279-4b31-9f89-11a1474458b5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:52.310243 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3c0b094-6279-4b31-9f89-11a1474458b5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:52.310798 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3c0b094-6279-4b31-9f89-11a1474458b5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:52.311330 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3c0b094-6279-4b31-9f89-11a1474458b5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:52.312090 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3c0b094-6279-4b31-9f89-11a1474458b5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:52.312615 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3c0b094-6279-4b31-9f89-11a1474458b5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:52.313402 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3c0b094-6279-4b31-9f89-11a1474458b5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:52.440853 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d3c0b094-6279-4b31-9f89-11a1474458b5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:52.448404 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d3c0b094-6279-4b31-9f89-11a1474458b5 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1498 microversion: 2.1 time: 0.148929 Sep 17 21:16:52.448999 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 551/1133] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:52 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:52.994572 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-165794ae-e9b5-44f1-b4e2-80df10dc9041 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:52.995173 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-165794ae-e9b5-44f1-b4e2-80df10dc9041 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:53.001460 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165794ae-e9b5-44f1-b4e2-80df10dc9041 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.002210 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165794ae-e9b5-44f1-b4e2-80df10dc9041 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.002683 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165794ae-e9b5-44f1-b4e2-80df10dc9041 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.003373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165794ae-e9b5-44f1-b4e2-80df10dc9041 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.003826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165794ae-e9b5-44f1-b4e2-80df10dc9041 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.004248 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165794ae-e9b5-44f1-b4e2-80df10dc9041 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.028806 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-165794ae-e9b5-44f1-b4e2-80df10dc9041 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:16:53.101560 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-165794ae-e9b5-44f1-b4e2-80df10dc9041 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 204 len: 0 microversion: 2.1 time: 0.110783 Sep 17 21:16:53.102398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 583/1134] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:16:52 2022] DELETE /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:16:53.110348 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-729ae32b-9b6a-4918-b116-b4197d391970 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:53.111697 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-729ae32b-9b6a-4918-b116-b4197d391970 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:53.114156 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:53.119600 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-729ae32b-9b6a-4918-b116-b4197d391970 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.120078 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-729ae32b-9b6a-4918-b116-b4197d391970 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.120507 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-729ae32b-9b6a-4918-b116-b4197d391970 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.121237 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-729ae32b-9b6a-4918-b116-b4197d391970 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.121693 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-729ae32b-9b6a-4918-b116-b4197d391970 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.122113 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-729ae32b-9b6a-4918-b116-b4197d391970 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.162787 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8676a35a-617c-4ea9-a0f3-e760d913db92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:53.163394 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8676a35a-617c-4ea9-a0f3-e760d913db92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:53.169392 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8676a35a-617c-4ea9-a0f3-e760d913db92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.169874 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8676a35a-617c-4ea9-a0f3-e760d913db92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.170308 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8676a35a-617c-4ea9-a0f3-e760d913db92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.171007 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8676a35a-617c-4ea9-a0f3-e760d913db92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.171461 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8676a35a-617c-4ea9-a0f3-e760d913db92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.171884 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8676a35a-617c-4ea9-a0f3-e760d913db92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.186068 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8676a35a-617c-4ea9-a0f3-e760d913db92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] HTTP exception thrown: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8676a35a-617c-4ea9-a0f3-e760d913db92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Request method failure captured: Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad HTTP/1.1 Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjhZ8Rpzpj5dpT6ab3M0cBQplyxStv5x4tEFLGvufqNEAS9XbA_csnSy33ax09N3LS-9-2rafCtGHxu78lyYEmOx5fAqlmtTlDj6a8-gbbTm1CYw1mwyATDl8YLTePpAA_6rO-c51WUJy8VjJEM5HkRHSlWnmLftRSte-bJjb-3xp1E Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: f58304cb0e1a42ce9bbc5ea8a3e58899 Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:16:53.187719 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:16:53.189721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:16:53.189721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:16:53.189721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: f58304cb0e1a42ce9bbc5ea8a3e58899 Sep 17 21:16:53.189721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:16:53.189721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-1802986980-project Sep 17 21:16:53.189721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:16:53.189721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:16:53.189721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 91f2a01f833d4751a6f81d6a8f11b8ed Sep 17 21:16:53.189721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-1802986980-project Sep 17 21:16:53.189721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:16:53.189721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:16:53.189721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '0c20c116-f378-4a7e-812b-45a6824e98ad'} Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:16:53.190606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:16:53.192017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:53.194508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8676a35a-617c-4ea9-a0f3-e760d913db92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Returning 404 to user: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:16:53.194508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8676a35a-617c-4ea9-a0f3-e760d913db92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 404 len: 111 microversion: 2.1 time: 0.031497 Sep 17 21:16:53.194508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 584/1135] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:53 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:16:53.264911 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-729ae32b-9b6a-4918-b116-b4197d391970 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:53.272944 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-729ae32b-9b6a-4918-b116-b4197d391970 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1504 microversion: 2.1 time: 0.166310 Sep 17 21:16:53.273541 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 552/1136] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:53 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:53.291169 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1911504481", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-70796160", "security_groups": [{"name": "tempest-secgroup-smoke-1359094004"}], "block_device_mapping_v2": [{"uuid": "fb3b767d-9b68-411c-ac11-6d567cb39458", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "39daaa91-156d-400a-8598-b2da78c5f62e"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:53.346480 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d4115b2d-e0c8-4b2d-9dda-db59847bac9b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:53.346968 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d4115b2d-e0c8-4b2d-9dda-db59847bac9b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:53.352807 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4115b2d-e0c8-4b2d-9dda-db59847bac9b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.353292 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4115b2d-e0c8-4b2d-9dda-db59847bac9b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.353707 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4115b2d-e0c8-4b2d-9dda-db59847bac9b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.354390 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4115b2d-e0c8-4b2d-9dda-db59847bac9b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.355932 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4115b2d-e0c8-4b2d-9dda-db59847bac9b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.356361 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4115b2d-e0c8-4b2d-9dda-db59847bac9b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.382346 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d4115b2d-e0c8-4b2d-9dda-db59847bac9b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:16:53.407415 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] validate_networks() for [('39daaa91-156d-400a-8598-b2da78c5f62e', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:16:53.462324 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d4115b2d-e0c8-4b2d-9dda-db59847bac9b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 204 len: 0 microversion: 2.1 time: 0.119383 Sep 17 21:16:53.462949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 553/1137] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:16:53 2022] DELETE /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:16:53.472049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c59644f5-a2fb-4115-b84d-090995546ff5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:53.472771 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c59644f5-a2fb-4115-b84d-090995546ff5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:53.478460 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c59644f5-a2fb-4115-b84d-090995546ff5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.478950 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c59644f5-a2fb-4115-b84d-090995546ff5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.479384 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c59644f5-a2fb-4115-b84d-090995546ff5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.480074 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c59644f5-a2fb-4115-b84d-090995546ff5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.480536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c59644f5-a2fb-4115-b84d-090995546ff5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.480984 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c59644f5-a2fb-4115-b84d-090995546ff5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.681006 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c59644f5-a2fb-4115-b84d-090995546ff5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:53.689710 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c59644f5-a2fb-4115-b84d-090995546ff5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1514 microversion: 2.1 time: 0.221752 Sep 17 21:16:53.690312 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 554/1138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:53 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:53.842244 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:16:53.842666 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:16:53.843133 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:16:53.843538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:16:53.843946 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:16:53.853369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.853842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.854269 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.854983 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.855433 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.855883 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.872790 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Getting quotas for project f58304cb0e1a42ce9bbc5ea8a3e58899. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:16:53.876689 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Getting quotas for user 91f2a01f833d4751a6f81d6a8f11b8ed and project f58304cb0e1a42ce9bbc5ea8a3e58899. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:16:53.933328 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:16:53.935441 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb3b767d-9b68-411c-ac11-6d567cb39458',volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:16:54.063352 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7c16848c-7238-436f-906f-1af0f094a197 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.776084 Sep 17 21:16:54.064741 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 585/1139] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:16:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:16:54.075014 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25bafdb5-6082-4812-b52a-03023e8e6e01 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:54.075746 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25bafdb5-6082-4812-b52a-03023e8e6e01 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:54.129184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-25bafdb5-6082-4812-b52a-03023e8e6e01 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:54.139407 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25bafdb5-6082-4812-b52a-03023e8e6e01 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1093 microversion: 2.1 time: 0.067247 Sep 17 21:16:54.140032 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 555/1140] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:54 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:54.296422 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-47095e09-e1ff-483e-a37c-6c7b8374ac5d tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:54.297093 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-47095e09-e1ff-483e-a37c-6c7b8374ac5d tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:54.303483 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47095e09-e1ff-483e-a37c-6c7b8374ac5d tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:54.303965 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47095e09-e1ff-483e-a37c-6c7b8374ac5d tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:54.304420 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47095e09-e1ff-483e-a37c-6c7b8374ac5d tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:54.305240 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47095e09-e1ff-483e-a37c-6c7b8374ac5d tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:54.306794 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47095e09-e1ff-483e-a37c-6c7b8374ac5d tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:54.307225 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47095e09-e1ff-483e-a37c-6c7b8374ac5d tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:54.443037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-47095e09-e1ff-483e-a37c-6c7b8374ac5d tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:54.450724 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-47095e09-e1ff-483e-a37c-6c7b8374ac5d tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1504 microversion: 2.1 time: 0.158157 Sep 17 21:16:54.451646 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 586/1141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:54 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:54.711870 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71d3887c-dc2b-4866-94bc-6489f0fdcd6c tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:54.712484 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-71d3887c-dc2b-4866-94bc-6489f0fdcd6c tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:54.718468 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d3887c-dc2b-4866-94bc-6489f0fdcd6c tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:54.718949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d3887c-dc2b-4866-94bc-6489f0fdcd6c tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:54.719378 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d3887c-dc2b-4866-94bc-6489f0fdcd6c tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:54.720061 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d3887c-dc2b-4866-94bc-6489f0fdcd6c tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:54.720844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d3887c-dc2b-4866-94bc-6489f0fdcd6c tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:54.721299 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d3887c-dc2b-4866-94bc-6489f0fdcd6c tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:54.847840 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-71d3887c-dc2b-4866-94bc-6489f0fdcd6c tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:54.855521 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71d3887c-dc2b-4866-94bc-6489f0fdcd6c tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1514 microversion: 2.1 time: 0.147477 Sep 17 21:16:54.856079 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 556/1142] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:54 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:55.162620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b856165-7152-4553-b517-a9a58126e32f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:55.163255 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5b856165-7152-4553-b517-a9a58126e32f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:55.169680 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b856165-7152-4553-b517-a9a58126e32f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:55.170161 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b856165-7152-4553-b517-a9a58126e32f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:55.170596 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b856165-7152-4553-b517-a9a58126e32f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:55.171281 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b856165-7152-4553-b517-a9a58126e32f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:55.171732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b856165-7152-4553-b517-a9a58126e32f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:55.172157 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b856165-7152-4553-b517-a9a58126e32f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:55.232345 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b856165-7152-4553-b517-a9a58126e32f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:55.240588 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b856165-7152-4553-b517-a9a58126e32f tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1143 microversion: 2.1 time: 0.081835 Sep 17 21:16:55.241173 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 587/1143] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:55 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:55.474158 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6dac82a7-96ea-4f2c-8a09-6c6858700e3a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:55.474762 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6dac82a7-96ea-4f2c-8a09-6c6858700e3a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:55.481084 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dac82a7-96ea-4f2c-8a09-6c6858700e3a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:55.481558 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dac82a7-96ea-4f2c-8a09-6c6858700e3a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:55.481984 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dac82a7-96ea-4f2c-8a09-6c6858700e3a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:55.482685 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dac82a7-96ea-4f2c-8a09-6c6858700e3a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:55.483133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dac82a7-96ea-4f2c-8a09-6c6858700e3a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:55.483548 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dac82a7-96ea-4f2c-8a09-6c6858700e3a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:55.488261 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:55.648446 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6dac82a7-96ea-4f2c-8a09-6c6858700e3a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:55.656976 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6dac82a7-96ea-4f2c-8a09-6c6858700e3a tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1504 microversion: 2.1 time: 0.187226 Sep 17 21:16:55.657544 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 557/1144] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:55 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:55.879194 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99f20f9d-f122-494e-8229-7143181a3a7a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:55.879820 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-99f20f9d-f122-494e-8229-7143181a3a7a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:55.885865 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99f20f9d-f122-494e-8229-7143181a3a7a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:55.886358 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99f20f9d-f122-494e-8229-7143181a3a7a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:55.886792 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99f20f9d-f122-494e-8229-7143181a3a7a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:55.887493 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99f20f9d-f122-494e-8229-7143181a3a7a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:55.887946 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99f20f9d-f122-494e-8229-7143181a3a7a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:55.888367 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99f20f9d-f122-494e-8229-7143181a3a7a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:56.093394 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-99f20f9d-f122-494e-8229-7143181a3a7a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:56.101454 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-99f20f9d-f122-494e-8229-7143181a3a7a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1514 microversion: 2.1 time: 0.226155 Sep 17 21:16:56.102931 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 588/1145] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:55 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:56.264566 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b37f5e8-748c-4bd7-88b6-4fec6f5dcb68 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:56.265434 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b37f5e8-748c-4bd7-88b6-4fec6f5dcb68 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:56.272085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a4601c01-fc95-4358-b55d-0901832f0f32 req-042fdc45-5447-4df9-933c-328c8bf0772a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a669608-0a73-401a-9ea8-5c989444c961", "name": "network-vif-deleted", "tag": "1b1338c7-e66d-4091-a6db-558dc699eba0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:56.278864 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b37f5e8-748c-4bd7-88b6-4fec6f5dcb68 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:56.282043 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b37f5e8-748c-4bd7-88b6-4fec6f5dcb68 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:56.282914 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b37f5e8-748c-4bd7-88b6-4fec6f5dcb68 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:56.284179 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a4601c01-fc95-4358-b55d-0901832f0f32 req-042fdc45-5447-4df9-933c-328c8bf0772a service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:56.284869 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a4601c01-fc95-4358-b55d-0901832f0f32 req-042fdc45-5447-4df9-933c-328c8bf0772a service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:56.285297 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a4601c01-fc95-4358-b55d-0901832f0f32 req-042fdc45-5447-4df9-933c-328c8bf0772a service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:56.286186 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b37f5e8-748c-4bd7-88b6-4fec6f5dcb68 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:56.286710 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b37f5e8-748c-4bd7-88b6-4fec6f5dcb68 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:56.288258 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b37f5e8-748c-4bd7-88b6-4fec6f5dcb68 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:56.297060 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a4601c01-fc95-4358-b55d-0901832f0f32 req-042fdc45-5447-4df9-933c-328c8bf0772a service nova] Creating event network-vif-deleted:1b1338c7-e66d-4091-a6db-558dc699eba0 for instance 1a669608-0a73-401a-9ea8-5c989444c961 on hv-cinder-82651 Sep 17 21:16:56.302533 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a4601c01-fc95-4358-b55d-0901832f0f32 req-042fdc45-5447-4df9-933c-328c8bf0772a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033828 Sep 17 21:16:56.303260 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 589/1146] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:56.360198 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b37f5e8-748c-4bd7-88b6-4fec6f5dcb68 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:56.373584 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b37f5e8-748c-4bd7-88b6-4fec6f5dcb68 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1191 microversion: 2.1 time: 0.113998 Sep 17 21:16:56.389535 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 558/1147] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:56 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1191 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:56.465379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d697ffc3-8355-4eeb-854d-1290e64cb5c6 req-d8d65c21-84c1-4f9a-9abd-898730c755a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c7c925-ef34-4794-86f0-6b405ae816e4", "name": "network-vif-deleted", "tag": "fb6fb3b5-c3b5-4cac-a927-b3f12ca803c1"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:56.475355 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d697ffc3-8355-4eeb-854d-1290e64cb5c6 req-d8d65c21-84c1-4f9a-9abd-898730c755a5 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:56.475831 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d697ffc3-8355-4eeb-854d-1290e64cb5c6 req-d8d65c21-84c1-4f9a-9abd-898730c755a5 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:56.476254 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d697ffc3-8355-4eeb-854d-1290e64cb5c6 req-d8d65c21-84c1-4f9a-9abd-898730c755a5 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:56.500085 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d697ffc3-8355-4eeb-854d-1290e64cb5c6 req-d8d65c21-84c1-4f9a-9abd-898730c755a5 service nova] Creating event network-vif-deleted:fb6fb3b5-c3b5-4cac-a927-b3f12ca803c1 for instance e3c7c925-ef34-4794-86f0-6b405ae816e4 on hv-cinder-82651 Sep 17 21:16:56.508494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d697ffc3-8355-4eeb-854d-1290e64cb5c6 req-d8d65c21-84c1-4f9a-9abd-898730c755a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048322 Sep 17 21:16:56.512832 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 590/1148] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:56.680291 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:56.680909 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:56.687319 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:56.688150 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:56.688707 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:56.689975 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:56.690493 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:56.691007 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:56.723682 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:56.724269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:56.724741 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:56.725282 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lazy-loading 'fault' on Instance uuid 1a669608-0a73-401a-9ea8-5c989444c961 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:16:56.780623 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a22c69a4e54c7896fa8e745d1dfc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a629d38940403aa7ee49b68f1d8ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:56.789084 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d46d71f3-7ed1-4f2a-85e5-93cecec9a4e1 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 200 len: 1304 microversion: 2.1 time: 0.112532 Sep 17 21:16:56.789660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 559/1149] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:56 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:57.126098 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:57.127667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:57.134405 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:57.135129 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:57.135555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:57.136399 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:57.137029 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:57.137657 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:57.173690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:57.174341 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:57.175037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:57.175652 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lazy-loading 'fault' on Instance uuid e3c7c925-ef34-4794-86f0-6b405ae816e4 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:16:57.249147 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:57.259826 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-16557695-86e9-4548-8014-e22aa701081b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 200 len: 1309 microversion: 2.1 time: 0.137958 Sep 17 21:16:57.260444 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 591/1150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:57 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 1309 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:57.397709 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ef0a03d-b932-42cf-8325-5c607091e614 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:57.398994 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ef0a03d-b932-42cf-8325-5c607091e614 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:57.405419 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ef0a03d-b932-42cf-8325-5c607091e614 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:57.405917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ef0a03d-b932-42cf-8325-5c607091e614 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:57.406360 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ef0a03d-b932-42cf-8325-5c607091e614 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:57.407071 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ef0a03d-b932-42cf-8325-5c607091e614 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:57.407537 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ef0a03d-b932-42cf-8325-5c607091e614 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:57.407974 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ef0a03d-b932-42cf-8325-5c607091e614 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:57.665700 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8ef0a03d-b932-42cf-8325-5c607091e614 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:57.673807 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ef0a03d-b932-42cf-8325-5c607091e614 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.279513 Sep 17 21:16:57.674803 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 560/1151] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:57 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:57.812483 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f336f9b-2dcb-448a-873c-f8c6d52aab12 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:57.813366 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f336f9b-2dcb-448a-873c-f8c6d52aab12 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] [instance: 1a669608-0a73-401a-9ea8-5c989444c961] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:57.819402 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f336f9b-2dcb-448a-873c-f8c6d52aab12 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:57.819884 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f336f9b-2dcb-448a-873c-f8c6d52aab12 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:57.820313 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f336f9b-2dcb-448a-873c-f8c6d52aab12 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:57.821030 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f336f9b-2dcb-448a-873c-f8c6d52aab12 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:57.821480 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f336f9b-2dcb-448a-873c-f8c6d52aab12 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:57.821898 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f336f9b-2dcb-448a-873c-f8c6d52aab12 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:57.836262 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-9f336f9b-2dcb-448a-873c-f8c6d52aab12 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] HTTP exception thrown: Instance 1a669608-0a73-401a-9ea8-5c989444c961 could not be found. Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f336f9b-2dcb-448a-873c-f8c6d52aab12 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Request method failure captured: Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 HTTP/1.1 Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjkYK07R-TdBtdfMGsCmLEW8MlrIoBEQdOFN_xGUiLC5nU8zgsTi42lGLymfz6JdNxLaCUgTbNCwg3ouQjKYSIZAkktI0rt6BnPg2lWjYF49vLEz9l3RlTkwaDd7wyjIVmkKaOwvqS-buNo1rV4wKlemQP8bJBHCvGq5Eyyth8q_U-w Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: 66a629d38940403aa7ee49b68f1d8ecf Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesActionsTest-718686079 Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:16:57.837951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:16:57.839932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/66a629d38940403aa7ee49b68f1d8ecf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66a629d38940403aa7ee49b68f1d8ecf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66a629d38940403aa7ee49b68f1d8ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_66a629d38940403aa7ee49b68f1d8ecf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:16:57.839932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesActionsTest-718686079 Sep 17 21:16:57.839932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: 66a629d38940403aa7ee49b68f1d8ecf Sep 17 21:16:57.839932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesActionsTest-718686079 Sep 17 21:16:57.839932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesActionsTest-718686079-project Sep 17 21:16:57.839932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:16:57.839932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:16:57.839932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 21a22c69a4e54c7896fa8e745d1dfc38 Sep 17 21:16:57.839932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesActionsTest-718686079-project Sep 17 21:16:57.839932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:16:57.839932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 1a669608-0a73-401a-9ea8-5c989444c961 could not be found. Sep 17 21:16:57.839932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '1a669608-0a73-401a-9ea8-5c989444c961'} Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a669608-0a73-401a-9ea8-5c989444c961 could not be found. Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:16:57.841628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a669608-0a73-401a-9ea8-5c989444c961 could not be found. Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a669608-0a73-401a-9ea8-5c989444c961 could not be found. Sep 17 21:16:57.843462 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:16:57.845897 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f336f9b-2dcb-448a-873c-f8c6d52aab12 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] Returning 404 to user: Instance 1a669608-0a73-401a-9ea8-5c989444c961 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:16:57.845897 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f336f9b-2dcb-448a-873c-f8c6d52aab12 tempest-VolumesActionsTest-718686079 tempest-VolumesActionsTest-718686079-project] 10.222.0.16 "GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961" status: 404 len: 111 microversion: 2.1 time: 0.030775 Sep 17 21:16:57.845897 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 592/1152] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:57 2022] GET /compute/v2.1/servers/1a669608-0a73-401a-9ea8-5c989444c961 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:16:58.284132 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4db8e838-fb59-4e57-85b2-4e52c625cea4 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:58.284790 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4db8e838-fb59-4e57-85b2-4e52c625cea4 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e3c7c925-ef34-4794-86f0-6b405ae816e4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:58.291448 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4db8e838-fb59-4e57-85b2-4e52c625cea4 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:58.291925 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4db8e838-fb59-4e57-85b2-4e52c625cea4 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:58.292352 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4db8e838-fb59-4e57-85b2-4e52c625cea4 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:58.293071 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4db8e838-fb59-4e57-85b2-4e52c625cea4 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:58.294046 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4db8e838-fb59-4e57-85b2-4e52c625cea4 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:58.294494 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4db8e838-fb59-4e57-85b2-4e52c625cea4 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:58.309873 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-4db8e838-fb59-4e57-85b2-4e52c625cea4 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] HTTP exception thrown: Instance e3c7c925-ef34-4794-86f0-6b405ae816e4 could not be found. Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4db8e838-fb59-4e57-85b2-4e52c625cea4 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Request method failure captured: Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 HTTP/1.1 Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjkEyWjRXaxUWIHgIXv_CRMMH5tvKyC07jSiKwBHsXkoDulQZUaCUcEvQQFMTSJ_mBb0-rac7tdWtzTA-Q-smRU0vYMYyv_4ucMqw3ZzLkEgEpz5IyMnhyHKoFnX4F1ALGW5x-2edFajKZer3lRaf7IchA5hwKuCTpA_EOtu3JJZ7tM Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: b48e7f3a322e47f9aa6224dac6a9e454 Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesSnapshotTestJSON-372753670 Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:16:58.311583 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:16:58.313355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b48e7f3a322e47f9aa6224dac6a9e454"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b48e7f3a322e47f9aa6224dac6a9e454"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b48e7f3a322e47f9aa6224dac6a9e454"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b48e7f3a322e47f9aa6224dac6a9e454"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:16:58.313355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesSnapshotTestJSON-372753670 Sep 17 21:16:58.313355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: b48e7f3a322e47f9aa6224dac6a9e454 Sep 17 21:16:58.313355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-372753670 Sep 17 21:16:58.313355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesSnapshotTestJSON-372753670-project Sep 17 21:16:58.313355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:16:58.313355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:16:58.313355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 94bd6c08de8743cd989ed3f88ed2aa9f Sep 17 21:16:58.313355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesSnapshotTestJSON-372753670-project Sep 17 21:16:58.313355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:16:58.313355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance e3c7c925-ef34-4794-86f0-6b405ae816e4 could not be found. Sep 17 21:16:58.313355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': 'e3c7c925-ef34-4794-86f0-6b405ae816e4'} Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c7c925-ef34-4794-86f0-6b405ae816e4 could not be found. Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:16:58.314288 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c7c925-ef34-4794-86f0-6b405ae816e4 could not be found. Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c7c925-ef34-4794-86f0-6b405ae816e4 could not be found. Sep 17 21:16:58.315747 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:16:58.317985 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4db8e838-fb59-4e57-85b2-4e52c625cea4 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Returning 404 to user: Instance e3c7c925-ef34-4794-86f0-6b405ae816e4 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:16:58.318158 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3cb1d334-65c5-4740-a493-effd16f1604d req-637d06ee-3cf6-4b53-8e46-e7736afc1162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba21559-e201-4ff9-9540-a3b4ff5669f9", "tag": "84d22448-fb27-4048-ad72-a4d673960323"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:58.326298 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4db8e838-fb59-4e57-85b2-4e52c625cea4 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4" status: 404 len: 111 microversion: 2.1 time: 0.046640 Sep 17 21:16:58.327049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 561/1153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:58 2022] GET /compute/v2.1/servers/e3c7c925-ef34-4794-86f0-6b405ae816e4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:16:58.328699 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3cb1d334-65c5-4740-a493-effd16f1604d req-637d06ee-3cf6-4b53-8e46-e7736afc1162 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:58.340128 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3cb1d334-65c5-4740-a493-effd16f1604d req-637d06ee-3cf6-4b53-8e46-e7736afc1162 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:58.340128 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3cb1d334-65c5-4740-a493-effd16f1604d req-637d06ee-3cf6-4b53-8e46-e7736afc1162 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:58.343557 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3cb1d334-65c5-4740-a493-effd16f1604d req-637d06ee-3cf6-4b53-8e46-e7736afc1162 service nova] Creating event network-changed:84d22448-fb27-4048-ad72-a4d673960323 for instance bba21559-e201-4ff9-9540-a3b4ff5669f9 on hv-cinder-82651 Sep 17 21:16:58.348588 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3cb1d334-65c5-4740-a493-effd16f1604d req-637d06ee-3cf6-4b53-8e46-e7736afc1162 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034149 Sep 17 21:16:58.349347 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 593/1154] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:58.698406 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7917fb5c-fb66-4070-ba73-13bb0bd82d92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:58.699224 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7917fb5c-fb66-4070-ba73-13bb0bd82d92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:58.706526 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7917fb5c-fb66-4070-ba73-13bb0bd82d92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:58.707022 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7917fb5c-fb66-4070-ba73-13bb0bd82d92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:58.707454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7917fb5c-fb66-4070-ba73-13bb0bd82d92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:58.708388 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7917fb5c-fb66-4070-ba73-13bb0bd82d92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:58.710710 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7917fb5c-fb66-4070-ba73-13bb0bd82d92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:58.710710 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7917fb5c-fb66-4070-ba73-13bb0bd82d92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:58.900490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7917fb5c-fb66-4070-ba73-13bb0bd82d92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:58.908264 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7917fb5c-fb66-4070-ba73-13bb0bd82d92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.214908 Sep 17 21:16:58.908838 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 562/1155] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:58 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:59.931712 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d7203bda-cbc3-4c9e-9b85-76bdaff871a4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:59.932436 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d7203bda-cbc3-4c9e-9b85-76bdaff871a4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:59.938841 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7203bda-cbc3-4c9e-9b85-76bdaff871a4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:59.939317 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7203bda-cbc3-4c9e-9b85-76bdaff871a4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:59.939745 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7203bda-cbc3-4c9e-9b85-76bdaff871a4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:59.940431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7203bda-cbc3-4c9e-9b85-76bdaff871a4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:59.940915 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7203bda-cbc3-4c9e-9b85-76bdaff871a4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:59.941331 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7203bda-cbc3-4c9e-9b85-76bdaff871a4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:00.069905 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d7203bda-cbc3-4c9e-9b85-76bdaff871a4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:00.072153 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:00.078739 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d7203bda-cbc3-4c9e-9b85-76bdaff871a4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.151851 Sep 17 21:17:00.079799 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 594/1156] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:59 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:01.102314 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30ce9f43-53cc-4f22-887c-a167e568d3ba tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:01.102863 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30ce9f43-53cc-4f22-887c-a167e568d3ba tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:01.109806 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30ce9f43-53cc-4f22-887c-a167e568d3ba tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:01.110285 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30ce9f43-53cc-4f22-887c-a167e568d3ba tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:01.110803 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30ce9f43-53cc-4f22-887c-a167e568d3ba tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:01.111694 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30ce9f43-53cc-4f22-887c-a167e568d3ba tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:01.112149 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30ce9f43-53cc-4f22-887c-a167e568d3ba tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:01.112574 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30ce9f43-53cc-4f22-887c-a167e568d3ba tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:01.246379 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-30ce9f43-53cc-4f22-887c-a167e568d3ba tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:01.254596 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30ce9f43-53cc-4f22-887c-a167e568d3ba tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.156240 Sep 17 21:17:01.255154 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 563/1157] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:01 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:02.279627 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73c2a28b-3086-41d5-9669-5ddce7017049 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:02.280303 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-73c2a28b-3086-41d5-9669-5ddce7017049 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:02.289023 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73c2a28b-3086-41d5-9669-5ddce7017049 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:02.289538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73c2a28b-3086-41d5-9669-5ddce7017049 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:02.289969 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73c2a28b-3086-41d5-9669-5ddce7017049 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:02.290656 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73c2a28b-3086-41d5-9669-5ddce7017049 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:02.291107 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73c2a28b-3086-41d5-9669-5ddce7017049 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:02.291521 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73c2a28b-3086-41d5-9669-5ddce7017049 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:02.421996 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-73c2a28b-3086-41d5-9669-5ddce7017049 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:02.429833 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-73c2a28b-3086-41d5-9669-5ddce7017049 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.155431 Sep 17 21:17:02.430390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 595/1158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:02 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:03.452801 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61a5132f-345c-4da4-9386-f5bf37d29997 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:03.453447 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61a5132f-345c-4da4-9386-f5bf37d29997 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:03.459917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61a5132f-345c-4da4-9386-f5bf37d29997 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:03.460397 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61a5132f-345c-4da4-9386-f5bf37d29997 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:03.460871 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61a5132f-345c-4da4-9386-f5bf37d29997 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:03.461561 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61a5132f-345c-4da4-9386-f5bf37d29997 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:03.462016 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61a5132f-345c-4da4-9386-f5bf37d29997 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:03.462437 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61a5132f-345c-4da4-9386-f5bf37d29997 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:03.591753 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-61a5132f-345c-4da4-9386-f5bf37d29997 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:03.600051 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61a5132f-345c-4da4-9386-f5bf37d29997 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.151110 Sep 17 21:17:03.600612 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 564/1159] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:03 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:04.628743 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b1b2d13-4955-4059-9f57-892b252513c7 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:04.629369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b1b2d13-4955-4059-9f57-892b252513c7 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:04.631656 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:04.632314 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:04.638181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1b2d13-4955-4059-9f57-892b252513c7 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:04.638655 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1b2d13-4955-4059-9f57-892b252513c7 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:04.639086 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1b2d13-4955-4059-9f57-892b252513c7 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:04.639777 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1b2d13-4955-4059-9f57-892b252513c7 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:04.640227 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1b2d13-4955-4059-9f57-892b252513c7 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:04.640693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1b2d13-4955-4059-9f57-892b252513c7 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:04.774037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b1b2d13-4955-4059-9f57-892b252513c7 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:04.781608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b1b2d13-4955-4059-9f57-892b252513c7 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.157391 Sep 17 21:17:04.782207 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 596/1160] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:04 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:05.804495 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8086b859-ecf1-44fd-8a59-7ed0d7b051b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:05.805158 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8086b859-ecf1-44fd-8a59-7ed0d7b051b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:05.806964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:05.812582 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8086b859-ecf1-44fd-8a59-7ed0d7b051b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:05.813337 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8086b859-ecf1-44fd-8a59-7ed0d7b051b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:05.813764 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8086b859-ecf1-44fd-8a59-7ed0d7b051b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:05.814594 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8086b859-ecf1-44fd-8a59-7ed0d7b051b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:05.815051 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8086b859-ecf1-44fd-8a59-7ed0d7b051b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:05.815470 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8086b859-ecf1-44fd-8a59-7ed0d7b051b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:05.944039 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8086b859-ecf1-44fd-8a59-7ed0d7b051b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:05.951734 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8086b859-ecf1-44fd-8a59-7ed0d7b051b3 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.151064 Sep 17 21:17:05.952279 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 565/1161] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:05 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:06.974948 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2aec7390-9571-4c8c-995b-4bb240923381 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:06.975566 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2aec7390-9571-4c8c-995b-4bb240923381 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:06.983096 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2aec7390-9571-4c8c-995b-4bb240923381 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:06.983579 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2aec7390-9571-4c8c-995b-4bb240923381 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:06.984011 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2aec7390-9571-4c8c-995b-4bb240923381 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:06.984733 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2aec7390-9571-4c8c-995b-4bb240923381 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:06.990663 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2aec7390-9571-4c8c-995b-4bb240923381 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:06.990663 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2aec7390-9571-4c8c-995b-4bb240923381 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:07.215301 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-2aec7390-9571-4c8c-995b-4bb240923381 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:07.223037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2aec7390-9571-4c8c-995b-4bb240923381 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.252847 Sep 17 21:17:07.223608 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 597/1162] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:06 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:08.244953 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2de1a2cc-4b5a-49e3-9207-7ad0ce6fc366 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:08.245558 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2de1a2cc-4b5a-49e3-9207-7ad0ce6fc366 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:08.252454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2de1a2cc-4b5a-49e3-9207-7ad0ce6fc366 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:08.252960 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2de1a2cc-4b5a-49e3-9207-7ad0ce6fc366 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:08.253393 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2de1a2cc-4b5a-49e3-9207-7ad0ce6fc366 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:08.254078 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2de1a2cc-4b5a-49e3-9207-7ad0ce6fc366 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:08.254526 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2de1a2cc-4b5a-49e3-9207-7ad0ce6fc366 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:08.254940 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2de1a2cc-4b5a-49e3-9207-7ad0ce6fc366 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:08.385020 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2de1a2cc-4b5a-49e3-9207-7ad0ce6fc366 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:08.393593 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2de1a2cc-4b5a-49e3-9207-7ad0ce6fc366 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.151511 Sep 17 21:17:08.394164 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 566/1163] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:08 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:09.419302 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8bc1bffa-99a3-4e8e-96b3-61e369f43f23 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:09.420641 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8bc1bffa-99a3-4e8e-96b3-61e369f43f23 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:09.427734 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bc1bffa-99a3-4e8e-96b3-61e369f43f23 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:09.428154 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bc1bffa-99a3-4e8e-96b3-61e369f43f23 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:09.428599 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bc1bffa-99a3-4e8e-96b3-61e369f43f23 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:09.429543 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bc1bffa-99a3-4e8e-96b3-61e369f43f23 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:09.430015 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bc1bffa-99a3-4e8e-96b3-61e369f43f23 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:09.430646 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bc1bffa-99a3-4e8e-96b3-61e369f43f23 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:09.569555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8bc1bffa-99a3-4e8e-96b3-61e369f43f23 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:09.577670 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8bc1bffa-99a3-4e8e-96b3-61e369f43f23 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.162177 Sep 17 21:17:09.578267 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 598/1164] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:09 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:10.605698 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df94b8e0-8982-4345-b324-4d86d0f9a79d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:10.607872 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-df94b8e0-8982-4345-b324-4d86d0f9a79d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:10.615678 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df94b8e0-8982-4345-b324-4d86d0f9a79d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:10.616389 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df94b8e0-8982-4345-b324-4d86d0f9a79d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:10.616855 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df94b8e0-8982-4345-b324-4d86d0f9a79d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:10.617680 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df94b8e0-8982-4345-b324-4d86d0f9a79d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:10.618143 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df94b8e0-8982-4345-b324-4d86d0f9a79d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:10.618566 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df94b8e0-8982-4345-b324-4d86d0f9a79d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:10.771718 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-df94b8e0-8982-4345-b324-4d86d0f9a79d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:10.780019 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df94b8e0-8982-4345-b324-4d86d0f9a79d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.181746 Sep 17 21:17:10.780698 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 567/1165] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:10 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:11.804474 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f913cab4-1d20-44c2-ab35-8c3c37c6cf11 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:11.805308 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f913cab4-1d20-44c2-ab35-8c3c37c6cf11 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:11.812075 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f913cab4-1d20-44c2-ab35-8c3c37c6cf11 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:11.813058 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f913cab4-1d20-44c2-ab35-8c3c37c6cf11 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:11.813738 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f913cab4-1d20-44c2-ab35-8c3c37c6cf11 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:11.815843 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f913cab4-1d20-44c2-ab35-8c3c37c6cf11 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:11.816899 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f913cab4-1d20-44c2-ab35-8c3c37c6cf11 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:11.817490 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f913cab4-1d20-44c2-ab35-8c3c37c6cf11 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:11.977164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-f913cab4-1d20-44c2-ab35-8c3c37c6cf11 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:11.988816 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f913cab4-1d20-44c2-ab35-8c3c37c6cf11 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.188488 Sep 17 21:17:11.989984 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 599/1166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:11 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:13.015276 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-149f3995-bf57-4324-964f-5c451f406f79 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:13.016603 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-149f3995-bf57-4324-964f-5c451f406f79 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:13.025359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-149f3995-bf57-4324-964f-5c451f406f79 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:13.026163 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-149f3995-bf57-4324-964f-5c451f406f79 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:13.026830 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-149f3995-bf57-4324-964f-5c451f406f79 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:13.027914 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-149f3995-bf57-4324-964f-5c451f406f79 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:13.028544 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-149f3995-bf57-4324-964f-5c451f406f79 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:13.028991 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-149f3995-bf57-4324-964f-5c451f406f79 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:13.171430 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-149f3995-bf57-4324-964f-5c451f406f79 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:13.180096 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-149f3995-bf57-4324-964f-5c451f406f79 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.168608 Sep 17 21:17:13.180664 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 568/1167] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:13 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:13.447450 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-171055451", "imageRef": "d51862da-04ce-4c92-b8ba-bd745384673c", "flavorRef": "452", "networks": [{"uuid": "a94e86be-a0c6-4a92-8000-9151a5a0be32"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:13.506456 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] validate_networks() for [('a94e86be-a0c6-4a92-8000-9151a5a0be32', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:17:13.942649 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:17:13.943274 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:17:13.943873 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:17:13.944475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:17:13.945071 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:17:13.957246 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:13.958281 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:13.958724 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:13.959823 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:13.960786 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:13.961369 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:13.987700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Getting quotas for project b48e7f3a322e47f9aa6224dac6a9e454. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:17:13.994106 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.quota [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Getting quotas for user 94bd6c08de8743cd989ed3f88ed2aa9f and project b48e7f3a322e47f9aa6224dac6a9e454. Resources: {'instances', 'ram', 'cores'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:17:14.007774 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:17:14.010463 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d51862da-04ce-4c92-b8ba-bd745384673c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:17:14.075248 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea087a07-8346-4b80-b764-396acadf5c55 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631228 Sep 17 21:17:14.076107 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 600/1168] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:17:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:17:14.089905 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f92bd731-6206-4f47-8a4c-bff5974de25a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:14.090636 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f92bd731-6206-4f47-8a4c-bff5974de25a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:14.169315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f92bd731-6206-4f47-8a4c-bff5974de25a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:14.177679 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f92bd731-6206-4f47-8a4c-bff5974de25a tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1218 microversion: 2.1 time: 0.091835 Sep 17 21:17:14.178852 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 569/1169] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:14 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:14.203864 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a8de8f8-14c1-4e97-8100-5a8aa93020fe tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:14.204492 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7a8de8f8-14c1-4e97-8100-5a8aa93020fe tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:14.218896 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a8de8f8-14c1-4e97-8100-5a8aa93020fe tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:14.218896 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a8de8f8-14c1-4e97-8100-5a8aa93020fe tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:14.219092 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a8de8f8-14c1-4e97-8100-5a8aa93020fe tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:14.220773 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a8de8f8-14c1-4e97-8100-5a8aa93020fe tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:14.220773 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a8de8f8-14c1-4e97-8100-5a8aa93020fe tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:14.221171 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a8de8f8-14c1-4e97-8100-5a8aa93020fe tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:14.423535 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7a8de8f8-14c1-4e97-8100-5a8aa93020fe tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:14.435393 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7a8de8f8-14c1-4e97-8100-5a8aa93020fe tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.235995 Sep 17 21:17:14.436331 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 601/1170] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:14 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:15.201774 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-940c72e1-332c-4526-94ce-c68e6759f4a1 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:15.203096 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-940c72e1-332c-4526-94ce-c68e6759f4a1 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:15.210772 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-940c72e1-332c-4526-94ce-c68e6759f4a1 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:15.211701 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-940c72e1-332c-4526-94ce-c68e6759f4a1 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:15.212463 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-940c72e1-332c-4526-94ce-c68e6759f4a1 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:15.213425 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-940c72e1-332c-4526-94ce-c68e6759f4a1 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:15.214145 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-940c72e1-332c-4526-94ce-c68e6759f4a1 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:15.214795 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-940c72e1-332c-4526-94ce-c68e6759f4a1 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:15.291770 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-940c72e1-332c-4526-94ce-c68e6759f4a1 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:15.300820 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-940c72e1-332c-4526-94ce-c68e6759f4a1 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1270 microversion: 2.1 time: 0.102907 Sep 17 21:17:15.302732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 570/1171] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:15 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:15.460019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-67174312-5d18-4b10-b9fd-7574db042be4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:15.461428 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-67174312-5d18-4b10-b9fd-7574db042be4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:15.469837 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67174312-5d18-4b10-b9fd-7574db042be4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:15.471143 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67174312-5d18-4b10-b9fd-7574db042be4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:15.471912 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67174312-5d18-4b10-b9fd-7574db042be4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:15.472698 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67174312-5d18-4b10-b9fd-7574db042be4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:15.473664 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67174312-5d18-4b10-b9fd-7574db042be4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:15.474593 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67174312-5d18-4b10-b9fd-7574db042be4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:15.806373 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-67174312-5d18-4b10-b9fd-7574db042be4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:15.818144 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-67174312-5d18-4b10-b9fd-7574db042be4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.363388 Sep 17 21:17:15.833351 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 602/1172] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:15 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:16.335319 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-868aa9d9-a705-4c3a-9e9a-d74bd31a4740 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:16.337655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-868aa9d9-a705-4c3a-9e9a-d74bd31a4740 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:16.346906 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-868aa9d9-a705-4c3a-9e9a-d74bd31a4740 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:16.347791 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-868aa9d9-a705-4c3a-9e9a-d74bd31a4740 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:16.348472 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-868aa9d9-a705-4c3a-9e9a-d74bd31a4740 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:16.349620 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-868aa9d9-a705-4c3a-9e9a-d74bd31a4740 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:16.350231 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-868aa9d9-a705-4c3a-9e9a-d74bd31a4740 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:16.350808 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-868aa9d9-a705-4c3a-9e9a-d74bd31a4740 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:16.571299 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-868aa9d9-a705-4c3a-9e9a-d74bd31a4740 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:16.585692 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-868aa9d9-a705-4c3a-9e9a-d74bd31a4740 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1318 microversion: 2.1 time: 0.261892 Sep 17 21:17:16.605477 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 571/1173] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:16 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:16.846485 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89e07f6e-6f8f-4fda-9c44-938ac77c3a62 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:16.847406 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-89e07f6e-6f8f-4fda-9c44-938ac77c3a62 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:16.859969 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89e07f6e-6f8f-4fda-9c44-938ac77c3a62 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:16.861406 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89e07f6e-6f8f-4fda-9c44-938ac77c3a62 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:16.862590 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89e07f6e-6f8f-4fda-9c44-938ac77c3a62 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:16.864014 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89e07f6e-6f8f-4fda-9c44-938ac77c3a62 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:16.865482 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89e07f6e-6f8f-4fda-9c44-938ac77c3a62 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:16.868074 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89e07f6e-6f8f-4fda-9c44-938ac77c3a62 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:17.152153 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-89e07f6e-6f8f-4fda-9c44-938ac77c3a62 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:17.162510 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89e07f6e-6f8f-4fda-9c44-938ac77c3a62 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.321500 Sep 17 21:17:17.163853 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 603/1174] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:16 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:17.317138 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-57c3d1a6-1466-4576-b57d-8f7dd796fd62 req-276ae887-c9cb-465a-a817-ea876b3ff9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba21559-e201-4ff9-9540-a3b4ff5669f9", "name": "network-vif-plugged", "status": "completed", "tag": "84d22448-fb27-4048-ad72-a4d673960323"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:17.337427 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-57c3d1a6-1466-4576-b57d-8f7dd796fd62 req-276ae887-c9cb-465a-a817-ea876b3ff9b9 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:17.338141 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-57c3d1a6-1466-4576-b57d-8f7dd796fd62 req-276ae887-c9cb-465a-a817-ea876b3ff9b9 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:17.338377 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-57c3d1a6-1466-4576-b57d-8f7dd796fd62 req-276ae887-c9cb-465a-a817-ea876b3ff9b9 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:17.354877 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-57c3d1a6-1466-4576-b57d-8f7dd796fd62 req-276ae887-c9cb-465a-a817-ea876b3ff9b9 service nova] Creating event network-vif-plugged:84d22448-fb27-4048-ad72-a4d673960323 for instance bba21559-e201-4ff9-9540-a3b4ff5669f9 on hv-cinder-82651 Sep 17 21:17:17.361152 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-57c3d1a6-1466-4576-b57d-8f7dd796fd62 req-276ae887-c9cb-465a-a817-ea876b3ff9b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056496 Sep 17 21:17:17.362085 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 572/1175] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:17.485943 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-481c0031-0df3-4253-aacf-b40475ea52ca req-99671cd9-29dc-4ccd-bdc8-ec74a7f67372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8739506-0ab4-43f7-b995-7cdd85dd8b53", "tag": "dde1bada-0853-4738-841d-90addd982d4b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:17.497725 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-481c0031-0df3-4253-aacf-b40475ea52ca req-99671cd9-29dc-4ccd-bdc8-ec74a7f67372 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:17.498592 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-481c0031-0df3-4253-aacf-b40475ea52ca req-99671cd9-29dc-4ccd-bdc8-ec74a7f67372 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:17.499630 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-481c0031-0df3-4253-aacf-b40475ea52ca req-99671cd9-29dc-4ccd-bdc8-ec74a7f67372 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:17.513976 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-481c0031-0df3-4253-aacf-b40475ea52ca req-99671cd9-29dc-4ccd-bdc8-ec74a7f67372 service nova] Creating event network-changed:dde1bada-0853-4738-841d-90addd982d4b for instance e8739506-0ab4-43f7-b995-7cdd85dd8b53 on hv-cinder-82651 Sep 17 21:17:17.522840 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-481c0031-0df3-4253-aacf-b40475ea52ca req-99671cd9-29dc-4ccd-bdc8-ec74a7f67372 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039448 Sep 17 21:17:17.523621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 604/1176] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:17:17.612514 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2815abcd-f4d6-4cac-b13c-2e5a0fc6d2a0 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:17.613165 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2815abcd-f4d6-4cac-b13c-2e5a0fc6d2a0 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:17.619646 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2815abcd-f4d6-4cac-b13c-2e5a0fc6d2a0 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:17.620137 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2815abcd-f4d6-4cac-b13c-2e5a0fc6d2a0 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:17.620564 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2815abcd-f4d6-4cac-b13c-2e5a0fc6d2a0 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:17.621485 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2815abcd-f4d6-4cac-b13c-2e5a0fc6d2a0 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:17.621942 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2815abcd-f4d6-4cac-b13c-2e5a0fc6d2a0 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:17.622362 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2815abcd-f4d6-4cac-b13c-2e5a0fc6d2a0 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:17.825924 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2815abcd-f4d6-4cac-b13c-2e5a0fc6d2a0 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:17.833991 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2815abcd-f4d6-4cac-b13c-2e5a0fc6d2a0 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1318 microversion: 2.1 time: 0.226073 Sep 17 21:17:17.844699 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 573/1177] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:17 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:18.200235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-711697d3-a831-4a94-8047-c2657c4091e6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:18.206475 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-711697d3-a831-4a94-8047-c2657c4091e6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:18.219387 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-711697d3-a831-4a94-8047-c2657c4091e6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:18.219951 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-711697d3-a831-4a94-8047-c2657c4091e6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:18.220466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-711697d3-a831-4a94-8047-c2657c4091e6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:18.221348 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-711697d3-a831-4a94-8047-c2657c4091e6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:18.221980 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-711697d3-a831-4a94-8047-c2657c4091e6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:18.222614 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-711697d3-a831-4a94-8047-c2657c4091e6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:18.377339 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-711697d3-a831-4a94-8047-c2657c4091e6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:18.385116 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-711697d3-a831-4a94-8047-c2657c4091e6 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.192080 Sep 17 21:17:18.385708 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 605/1178] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:18 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:17:18.859291 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d740df28-823b-472f-aee9-b33cc42d5711 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:18.861216 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d740df28-823b-472f-aee9-b33cc42d5711 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:18.868631 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d740df28-823b-472f-aee9-b33cc42d5711 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:18.869472 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d740df28-823b-472f-aee9-b33cc42d5711 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:18.870146 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d740df28-823b-472f-aee9-b33cc42d5711 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:18.871073 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d740df28-823b-472f-aee9-b33cc42d5711 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:18.871744 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d740df28-823b-472f-aee9-b33cc42d5711 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:18.873964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d740df28-823b-472f-aee9-b33cc42d5711 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:19.088753 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d740df28-823b-472f-aee9-b33cc42d5711 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:19.097113 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d740df28-823b-472f-aee9-b33cc42d5711 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1318 microversion: 2.1 time: 0.241760 Sep 17 21:17:19.108880 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 574/1179] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:18 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:19.407853 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e01fc3d3-15df-41ea-a706-2ce567385cb0 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:19.408782 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e01fc3d3-15df-41ea-a706-2ce567385cb0 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:19.416241 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e01fc3d3-15df-41ea-a706-2ce567385cb0 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:19.416787 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e01fc3d3-15df-41ea-a706-2ce567385cb0 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:19.418124 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e01fc3d3-15df-41ea-a706-2ce567385cb0 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:19.420129 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e01fc3d3-15df-41ea-a706-2ce567385cb0 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:19.420904 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e01fc3d3-15df-41ea-a706-2ce567385cb0 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:19.421616 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e01fc3d3-15df-41ea-a706-2ce567385cb0 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:19.572879 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e01fc3d3-15df-41ea-a706-2ce567385cb0 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:19.581585 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e01fc3d3-15df-41ea-a706-2ce567385cb0 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1265 microversion: 2.1 time: 0.177723 Sep 17 21:17:19.582240 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 606/1180] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:19 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:20.121805 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aabe7036-7086-4672-a1c1-8bd421493261 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:20.122563 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aabe7036-7086-4672-a1c1-8bd421493261 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:20.129393 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aabe7036-7086-4672-a1c1-8bd421493261 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.130133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aabe7036-7086-4672-a1c1-8bd421493261 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.130753 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aabe7036-7086-4672-a1c1-8bd421493261 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.131446 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aabe7036-7086-4672-a1c1-8bd421493261 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.131896 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aabe7036-7086-4672-a1c1-8bd421493261 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.132315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aabe7036-7086-4672-a1c1-8bd421493261 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.274794 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-aabe7036-7086-4672-a1c1-8bd421493261 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:20.277158 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:20.286548 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aabe7036-7086-4672-a1c1-8bd421493261 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1318 microversion: 2.1 time: 0.166876 Sep 17 21:17:20.287341 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 575/1181] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:20 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:20.613170 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e0972613-bf24-4d38-a34d-3ca67c8bdd5a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:20.624987 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e0972613-bf24-4d38-a34d-3ca67c8bdd5a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:20.632159 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0972613-bf24-4d38-a34d-3ca67c8bdd5a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.632648 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0972613-bf24-4d38-a34d-3ca67c8bdd5a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.633103 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0972613-bf24-4d38-a34d-3ca67c8bdd5a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.633806 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0972613-bf24-4d38-a34d-3ca67c8bdd5a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.634255 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0972613-bf24-4d38-a34d-3ca67c8bdd5a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.634682 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0972613-bf24-4d38-a34d-3ca67c8bdd5a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.778895 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e0972613-bf24-4d38-a34d-3ca67c8bdd5a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:20.787468 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e0972613-bf24-4d38-a34d-3ca67c8bdd5a tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1451 microversion: 2.1 time: 0.184779 Sep 17 21:17:20.788351 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 607/1182] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:20 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1451 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:20.809626 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52592e47-1e79-491f-a3bc-15d05246896b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:20.810235 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-52592e47-1e79-491f-a3bc-15d05246896b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:20.817299 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52592e47-1e79-491f-a3bc-15d05246896b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.817786 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52592e47-1e79-491f-a3bc-15d05246896b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.818219 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52592e47-1e79-491f-a3bc-15d05246896b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.818913 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52592e47-1e79-491f-a3bc-15d05246896b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.819365 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52592e47-1e79-491f-a3bc-15d05246896b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.819787 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52592e47-1e79-491f-a3bc-15d05246896b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.959660 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-52592e47-1e79-491f-a3bc-15d05246896b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:20.968311 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52592e47-1e79-491f-a3bc-15d05246896b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1451 microversion: 2.1 time: 0.162599 Sep 17 21:17:20.969263 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 576/1183] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:20 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:17:21.314585 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7bff8436-9f0e-4351-9a5f-b7cd7848af1b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:21.315431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7bff8436-9f0e-4351-9a5f-b7cd7848af1b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:21.324912 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bff8436-9f0e-4351-9a5f-b7cd7848af1b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:21.325611 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bff8436-9f0e-4351-9a5f-b7cd7848af1b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:21.326572 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bff8436-9f0e-4351-9a5f-b7cd7848af1b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:21.328613 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bff8436-9f0e-4351-9a5f-b7cd7848af1b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:21.329110 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bff8436-9f0e-4351-9a5f-b7cd7848af1b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:21.330195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bff8436-9f0e-4351-9a5f-b7cd7848af1b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:21.584942 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7bff8436-9f0e-4351-9a5f-b7cd7848af1b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:21.597466 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7bff8436-9f0e-4351-9a5f-b7cd7848af1b tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1318 microversion: 2.1 time: 0.289792 Sep 17 21:17:21.598087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 608/1184] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:21 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:22.620410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-051aef17-1b8b-41e7-b233-68425da7e578 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:22.620410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-051aef17-1b8b-41e7-b233-68425da7e578 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:22.632917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-051aef17-1b8b-41e7-b233-68425da7e578 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:22.633701 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-051aef17-1b8b-41e7-b233-68425da7e578 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:22.634332 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-051aef17-1b8b-41e7-b233-68425da7e578 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:22.635269 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-051aef17-1b8b-41e7-b233-68425da7e578 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:22.636201 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-051aef17-1b8b-41e7-b233-68425da7e578 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:22.636830 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-051aef17-1b8b-41e7-b233-68425da7e578 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:22.894115 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-051aef17-1b8b-41e7-b233-68425da7e578 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:22.901748 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-051aef17-1b8b-41e7-b233-68425da7e578 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1318 microversion: 2.1 time: 0.285746 Sep 17 21:17:22.917270 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 577/1185] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:22 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:23.234304 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d58f2274-2941-497f-a031-c1b9bb6dcdbe req-1307cda0-e1b6-4126-84d9-2f0e58d1f73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba21559-e201-4ff9-9540-a3b4ff5669f9", "tag": "84d22448-fb27-4048-ad72-a4d673960323"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:23.244503 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:23.249248 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d58f2274-2941-497f-a031-c1b9bb6dcdbe req-1307cda0-e1b6-4126-84d9-2f0e58d1f73d service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:23.250059 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d58f2274-2941-497f-a031-c1b9bb6dcdbe req-1307cda0-e1b6-4126-84d9-2f0e58d1f73d service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:23.250581 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d58f2274-2941-497f-a031-c1b9bb6dcdbe req-1307cda0-e1b6-4126-84d9-2f0e58d1f73d service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:23.272251 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d58f2274-2941-497f-a031-c1b9bb6dcdbe req-1307cda0-e1b6-4126-84d9-2f0e58d1f73d service nova] Creating event network-changed:84d22448-fb27-4048-ad72-a4d673960323 for instance bba21559-e201-4ff9-9540-a3b4ff5669f9 on hv-cinder-82651 Sep 17 21:17:23.278666 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d58f2274-2941-497f-a031-c1b9bb6dcdbe req-1307cda0-e1b6-4126-84d9-2f0e58d1f73d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051263 Sep 17 21:17:23.280391 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 609/1186] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:23.408134 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-8d6feab4-1c2b-4dd7-ab47-c90bf3615408 req-5acf0cf1-4f45-4ecc-8261-c7d40294331c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8739506-0ab4-43f7-b995-7cdd85dd8b53", "name": "network-vif-plugged", "status": "completed", "tag": "dde1bada-0853-4738-841d-90addd982d4b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:23.421998 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:23.426656 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8d6feab4-1c2b-4dd7-ab47-c90bf3615408 req-5acf0cf1-4f45-4ecc-8261-c7d40294331c service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:23.427146 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8d6feab4-1c2b-4dd7-ab47-c90bf3615408 req-5acf0cf1-4f45-4ecc-8261-c7d40294331c service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:23.429721 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8d6feab4-1c2b-4dd7-ab47-c90bf3615408 req-5acf0cf1-4f45-4ecc-8261-c7d40294331c service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:23.466671 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-8d6feab4-1c2b-4dd7-ab47-c90bf3615408 req-5acf0cf1-4f45-4ecc-8261-c7d40294331c service nova] Creating event network-vif-plugged:dde1bada-0853-4738-841d-90addd982d4b for instance e8739506-0ab4-43f7-b995-7cdd85dd8b53 on hv-cinder-82651 Sep 17 21:17:23.473529 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-8d6feab4-1c2b-4dd7-ab47-c90bf3615408 req-5acf0cf1-4f45-4ecc-8261-c7d40294331c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069622 Sep 17 21:17:23.478022 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 578/1187] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:23.928580 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f508dd3-64cc-4efc-8971-afef2bf651ca tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:23.929756 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f508dd3-64cc-4efc-8971-afef2bf651ca tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:23.936519 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f508dd3-64cc-4efc-8971-afef2bf651ca tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:23.937142 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f508dd3-64cc-4efc-8971-afef2bf651ca tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:23.937817 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f508dd3-64cc-4efc-8971-afef2bf651ca tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:23.938770 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f508dd3-64cc-4efc-8971-afef2bf651ca tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:23.939394 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f508dd3-64cc-4efc-8971-afef2bf651ca tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:23.939811 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f508dd3-64cc-4efc-8971-afef2bf651ca tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:23.973728 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:24.003151 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:24.128402 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f508dd3-64cc-4efc-8971-afef2bf651ca tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:24.140620 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f508dd3-64cc-4efc-8971-afef2bf651ca tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1318 microversion: 2.1 time: 0.216203 Sep 17 21:17:24.141300 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 610/1188] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:23 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:25.161682 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:25.166394 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ec9d243-faa5-478c-96a3-791675033c90 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:25.167083 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2ec9d243-faa5-478c-96a3-791675033c90 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:25.173825 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ec9d243-faa5-478c-96a3-791675033c90 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:25.174295 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ec9d243-faa5-478c-96a3-791675033c90 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:25.174724 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ec9d243-faa5-478c-96a3-791675033c90 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:25.175410 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ec9d243-faa5-478c-96a3-791675033c90 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:25.175858 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ec9d243-faa5-478c-96a3-791675033c90 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:25.176273 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ec9d243-faa5-478c-96a3-791675033c90 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:25.310629 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ec9d243-faa5-478c-96a3-791675033c90 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:25.319117 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ec9d243-faa5-478c-96a3-791675033c90 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1318 microversion: 2.1 time: 0.158997 Sep 17 21:17:25.319681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 579/1189] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:25 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:26.342791 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0f5b9cd4-0a0c-4e7f-a41b-ab22923c1cc5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:26.343391 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0f5b9cd4-0a0c-4e7f-a41b-ab22923c1cc5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:26.350091 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f5b9cd4-0a0c-4e7f-a41b-ab22923c1cc5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:26.350568 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f5b9cd4-0a0c-4e7f-a41b-ab22923c1cc5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:26.351044 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f5b9cd4-0a0c-4e7f-a41b-ab22923c1cc5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:26.351727 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f5b9cd4-0a0c-4e7f-a41b-ab22923c1cc5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:26.352178 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f5b9cd4-0a0c-4e7f-a41b-ab22923c1cc5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:26.352596 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f5b9cd4-0a0c-4e7f-a41b-ab22923c1cc5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:26.484186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0f5b9cd4-0a0c-4e7f-a41b-ab22923c1cc5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:26.492367 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0f5b9cd4-0a0c-4e7f-a41b-ab22923c1cc5 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1507 microversion: 2.1 time: 0.153480 Sep 17 21:17:26.492958 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 611/1190] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:26 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:26.514931 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a84d7eb4-1483-408b-a9e4-842bc01f663e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b22ad45-81e4-47f3-be12-842e1937347e", "device": "/dev/sdb"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:26.517531 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a84d7eb4-1483-408b-a9e4-842bc01f663e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:26.523868 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a84d7eb4-1483-408b-a9e4-842bc01f663e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:26.524350 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a84d7eb4-1483-408b-a9e4-842bc01f663e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:26.524816 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a84d7eb4-1483-408b-a9e4-842bc01f663e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:26.525502 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a84d7eb4-1483-408b-a9e4-842bc01f663e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:26.525954 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a84d7eb4-1483-408b-a9e4-842bc01f663e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:26.526376 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a84d7eb4-1483-408b-a9e4-842bc01f663e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:26.767510 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a84d7eb4-1483-408b-a9e4-842bc01f663e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "POST /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256106 Sep 17 21:17:26.773401 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 580/1191] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 17 21:17:26 2022] POST /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:49.200803 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7cab3499-fc32-4394-b7e8-688106cb0734 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:49.201332 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7cab3499-fc32-4394-b7e8-688106cb0734 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:49.203394 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=5 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:49.204036 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=91 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:49.210497 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cab3499-fc32-4394-b7e8-688106cb0734 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:49.210973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cab3499-fc32-4394-b7e8-688106cb0734 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:49.211407 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cab3499-fc32-4394-b7e8-688106cb0734 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:49.212089 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cab3499-fc32-4394-b7e8-688106cb0734 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:49.212536 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cab3499-fc32-4394-b7e8-688106cb0734 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:49.212980 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cab3499-fc32-4394-b7e8-688106cb0734 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:49.291888 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-7cab3499-fc32-4394-b7e8-688106cb0734 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lazy-loading 'services' on Instance uuid e8739506-0ab4-43f7-b995-7cdd85dd8b53 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:17:49.363503 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7cab3499-fc32-4394-b7e8-688106cb0734 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53/os-volume_attachments/3b22ad45-81e4-47f3-be12-842e1937347e" status: 202 len: 0 microversion: 2.1 time: 0.166584 Sep 17 21:17:49.364088 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 612/1192] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 17 21:17:49 2022] DELETE /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53/os-volume_attachments/3b22ad45-81e4-47f3-be12-842e1937347e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:17:50.492570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc94c99b-c6c0-4228-8e0b-a29b2fbbad7e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:50.493168 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc94c99b-c6c0-4228-8e0b-a29b2fbbad7e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:50.495787 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=5 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:50.496446 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:50.502835 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc94c99b-c6c0-4228-8e0b-a29b2fbbad7e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:50.503324 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc94c99b-c6c0-4228-8e0b-a29b2fbbad7e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:50.503750 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc94c99b-c6c0-4228-8e0b-a29b2fbbad7e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:50.504440 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc94c99b-c6c0-4228-8e0b-a29b2fbbad7e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:50.504918 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc94c99b-c6c0-4228-8e0b-a29b2fbbad7e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:50.505342 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc94c99b-c6c0-4228-8e0b-a29b2fbbad7e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:50.531996 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc94c99b-c6c0-4228-8e0b-a29b2fbbad7e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:17:50.606046 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc94c99b-c6c0-4228-8e0b-a29b2fbbad7e tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 204 len: 0 microversion: 2.1 time: 0.117399 Sep 17 21:17:50.606885 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 581/1193] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:17:50 2022] DELETE /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:17:50.615809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7fc10722-e5ab-4489-8d57-3f90734d1b61 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:50.616506 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7fc10722-e5ab-4489-8d57-3f90734d1b61 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:50.622734 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fc10722-e5ab-4489-8d57-3f90734d1b61 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:50.623216 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fc10722-e5ab-4489-8d57-3f90734d1b61 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:50.623650 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fc10722-e5ab-4489-8d57-3f90734d1b61 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:50.624347 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fc10722-e5ab-4489-8d57-3f90734d1b61 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:50.624844 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fc10722-e5ab-4489-8d57-3f90734d1b61 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:50.625272 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fc10722-e5ab-4489-8d57-3f90734d1b61 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:50.753191 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7fc10722-e5ab-4489-8d57-3f90734d1b61 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:50.762574 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7fc10722-e5ab-4489-8d57-3f90734d1b61 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1513 microversion: 2.1 time: 0.151441 Sep 17 21:17:50.763135 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 613/1194] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:50 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:51.787372 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fe36d97d-96fa-44c3-863d-a5244c160182 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:51.788067 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fe36d97d-96fa-44c3-863d-a5244c160182 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:51.794435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe36d97d-96fa-44c3-863d-a5244c160182 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:51.794916 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe36d97d-96fa-44c3-863d-a5244c160182 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:51.795355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe36d97d-96fa-44c3-863d-a5244c160182 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:51.796041 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe36d97d-96fa-44c3-863d-a5244c160182 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:51.796495 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe36d97d-96fa-44c3-863d-a5244c160182 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:51.796953 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe36d97d-96fa-44c3-863d-a5244c160182 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:51.922781 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fe36d97d-96fa-44c3-863d-a5244c160182 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:51.938246 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fe36d97d-96fa-44c3-863d-a5244c160182 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1513 microversion: 2.1 time: 0.155636 Sep 17 21:17:51.938826 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 582/1195] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:51 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:52.966940 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1193c6e1-3a15-45f4-8c0c-00a49677e787 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:52.967782 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1193c6e1-3a15-45f4-8c0c-00a49677e787 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:52.974425 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1193c6e1-3a15-45f4-8c0c-00a49677e787 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:52.974879 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1193c6e1-3a15-45f4-8c0c-00a49677e787 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:52.975375 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1193c6e1-3a15-45f4-8c0c-00a49677e787 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:52.976323 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1193c6e1-3a15-45f4-8c0c-00a49677e787 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:52.976815 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1193c6e1-3a15-45f4-8c0c-00a49677e787 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:52.977925 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1193c6e1-3a15-45f4-8c0c-00a49677e787 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:53.067379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-1193c6e1-3a15-45f4-8c0c-00a49677e787 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bd6c08de8743cd989ed3f88ed2aa9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e7f3a322e47f9aa6224dac6a9e454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:53.067857 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a38e7770-8db8-4f63-8d46-420fbc049a88 req-d1a6641c-396a-4e61-bc70-150ccd5651b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8739506-0ab4-43f7-b995-7cdd85dd8b53", "name": "network-vif-deleted", "tag": "dde1bada-0853-4738-841d-90addd982d4b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:53.075498 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1193c6e1-3a15-45f4-8c0c-00a49677e787 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 200 len: 1471 microversion: 2.1 time: 0.112262 Sep 17 21:17:53.076007 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 614/1196] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:52 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 1471 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:53.079416 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a38e7770-8db8-4f63-8d46-420fbc049a88 req-d1a6641c-396a-4e61-bc70-150ccd5651b4 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:53.079881 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a38e7770-8db8-4f63-8d46-420fbc049a88 req-d1a6641c-396a-4e61-bc70-150ccd5651b4 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:53.080322 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a38e7770-8db8-4f63-8d46-420fbc049a88 req-d1a6641c-396a-4e61-bc70-150ccd5651b4 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:53.092917 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a38e7770-8db8-4f63-8d46-420fbc049a88 req-d1a6641c-396a-4e61-bc70-150ccd5651b4 service nova] Creating event network-vif-deleted:dde1bada-0853-4738-841d-90addd982d4b for instance e8739506-0ab4-43f7-b995-7cdd85dd8b53 on hv-cinder-82651 Sep 17 21:17:53.098306 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a38e7770-8db8-4f63-8d46-420fbc049a88 req-d1a6641c-396a-4e61-bc70-150ccd5651b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034697 Sep 17 21:17:53.099027 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 583/1197] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:17:54.099578 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d079a75-ed8a-4290-8195-b2069ee9dd08 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:54.100138 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2d079a75-ed8a-4290-8195-b2069ee9dd08 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] [instance: e8739506-0ab4-43f7-b995-7cdd85dd8b53] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:54.106430 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d079a75-ed8a-4290-8195-b2069ee9dd08 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:54.106905 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d079a75-ed8a-4290-8195-b2069ee9dd08 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:54.107335 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d079a75-ed8a-4290-8195-b2069ee9dd08 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:54.108020 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d079a75-ed8a-4290-8195-b2069ee9dd08 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:54.108467 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d079a75-ed8a-4290-8195-b2069ee9dd08 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:54.108921 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d079a75-ed8a-4290-8195-b2069ee9dd08 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:54.122166 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-2d079a75-ed8a-4290-8195-b2069ee9dd08 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] HTTP exception thrown: Instance e8739506-0ab4-43f7-b995-7cdd85dd8b53 could not be found. Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d079a75-ed8a-4290-8195-b2069ee9dd08 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Request method failure captured: Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 HTTP/1.1 Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjkEyWjRXaxUWIHgIXv_CRMMH5tvKyC07jSiKwBHsXkoDulQZUaCUcEvQQFMTSJ_mBb0-rac7tdWtzTA-Q-smRU0vYMYyv_4ucMqw3ZzLkEgEpz5IyMnhyHKoFnX4F1ALGW5x-2edFajKZer3lRaf7IchA5hwKuCTpA_EOtu3JJZ7tM Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: b48e7f3a322e47f9aa6224dac6a9e454 Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesSnapshotTestJSON-372753670 Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:17:54.123776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:17:54.125514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b48e7f3a322e47f9aa6224dac6a9e454"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b48e7f3a322e47f9aa6224dac6a9e454"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b48e7f3a322e47f9aa6224dac6a9e454"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b48e7f3a322e47f9aa6224dac6a9e454"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:17:54.125514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-VolumesSnapshotTestJSON-372753670 Sep 17 21:17:54.125514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: b48e7f3a322e47f9aa6224dac6a9e454 Sep 17 21:17:54.125514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-372753670 Sep 17 21:17:54.125514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-VolumesSnapshotTestJSON-372753670-project Sep 17 21:17:54.125514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:17:54.125514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:17:54.125514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 94bd6c08de8743cd989ed3f88ed2aa9f Sep 17 21:17:54.125514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-VolumesSnapshotTestJSON-372753670-project Sep 17 21:17:54.125514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:17:54.125514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance e8739506-0ab4-43f7-b995-7cdd85dd8b53 could not be found. Sep 17 21:17:54.125514 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': 'e8739506-0ab4-43f7-b995-7cdd85dd8b53'} Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8739506-0ab4-43f7-b995-7cdd85dd8b53 could not be found. Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:17:54.126494 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8739506-0ab4-43f7-b995-7cdd85dd8b53 could not be found. Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8739506-0ab4-43f7-b995-7cdd85dd8b53 could not be found. Sep 17 21:17:54.129035 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:17:54.130607 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d079a75-ed8a-4290-8195-b2069ee9dd08 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] Returning 404 to user: Instance e8739506-0ab4-43f7-b995-7cdd85dd8b53 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:17:54.130607 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2d079a75-ed8a-4290-8195-b2069ee9dd08 tempest-VolumesSnapshotTestJSON-372753670 tempest-VolumesSnapshotTestJSON-372753670-project] 10.222.0.16 "GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53" status: 404 len: 111 microversion: 2.1 time: 0.029956 Sep 17 21:17:54.130607 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 615/1198] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:54 2022] GET /compute/v2.1/servers/e8739506-0ab4-43f7-b995-7cdd85dd8b53 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:18:10.247910 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a689346c-a9e7-4088-8655-c482fd869730 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:10.250338 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a689346c-a9e7-4088-8655-c482fd869730 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:10.256062 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:10.257080 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:10.258584 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a689346c-a9e7-4088-8655-c482fd869730 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:10.259133 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a689346c-a9e7-4088-8655-c482fd869730 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:10.259523 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a689346c-a9e7-4088-8655-c482fd869730 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:10.260189 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a689346c-a9e7-4088-8655-c482fd869730 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:10.260889 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a689346c-a9e7-4088-8655-c482fd869730 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:10.261094 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a689346c-a9e7-4088-8655-c482fd869730 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:10.334808 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a689346c-a9e7-4088-8655-c482fd869730 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "POST /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/action" status: 202 len: 0 microversion: 2.1 time: 0.092688 Sep 17 21:18:10.335515 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 584/1199] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:18:10 2022] POST /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:18:10.343435 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a4eae637-87d5-4a69-8901-84b1ba71bffe tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:10.344053 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a4eae637-87d5-4a69-8901-84b1ba71bffe tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:10.346880 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:10.347538 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:10.353671 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4eae637-87d5-4a69-8901-84b1ba71bffe tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:10.354185 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4eae637-87d5-4a69-8901-84b1ba71bffe tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:10.354596 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4eae637-87d5-4a69-8901-84b1ba71bffe tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:10.355309 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4eae637-87d5-4a69-8901-84b1ba71bffe tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:10.355765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4eae637-87d5-4a69-8901-84b1ba71bffe tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:10.356197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4eae637-87d5-4a69-8901-84b1ba71bffe tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:10.589672 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-a4eae637-87d5-4a69-8901-84b1ba71bffe tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:10.598313 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a4eae637-87d5-4a69-8901-84b1ba71bffe tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1753 microversion: 2.1 time: 0.258663 Sep 17 21:18:10.598881 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 616/1200] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:10 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1753 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:11.626552 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77c0045f-c794-48c2-b2ef-4ff4f6ea5982 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:11.627279 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77c0045f-c794-48c2-b2ef-4ff4f6ea5982 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:11.633421 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c0045f-c794-48c2-b2ef-4ff4f6ea5982 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:11.633842 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c0045f-c794-48c2-b2ef-4ff4f6ea5982 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:11.634272 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c0045f-c794-48c2-b2ef-4ff4f6ea5982 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:11.634959 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c0045f-c794-48c2-b2ef-4ff4f6ea5982 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:11.635414 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c0045f-c794-48c2-b2ef-4ff4f6ea5982 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:11.635832 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c0045f-c794-48c2-b2ef-4ff4f6ea5982 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:11.779107 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-77c0045f-c794-48c2-b2ef-4ff4f6ea5982 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:11.787721 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77c0045f-c794-48c2-b2ef-4ff4f6ea5982 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.165814 Sep 17 21:18:11.788279 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 585/1201] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:11 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:12.810670 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e6999d22-3e87-4f80-888e-43da455f5516 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:12.811199 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e6999d22-3e87-4f80-888e-43da455f5516 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:12.817738 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6999d22-3e87-4f80-888e-43da455f5516 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:12.818219 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6999d22-3e87-4f80-888e-43da455f5516 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:12.818656 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6999d22-3e87-4f80-888e-43da455f5516 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:12.819348 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6999d22-3e87-4f80-888e-43da455f5516 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:12.819815 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6999d22-3e87-4f80-888e-43da455f5516 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:12.820223 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6999d22-3e87-4f80-888e-43da455f5516 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:12.961397 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e6999d22-3e87-4f80-888e-43da455f5516 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:12.969507 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e6999d22-3e87-4f80-888e-43da455f5516 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.162879 Sep 17 21:18:12.970059 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 617/1202] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:12 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:13.993844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-42c97f6b-783e-452b-a3dc-398a834839b9 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:13.994489 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-42c97f6b-783e-452b-a3dc-398a834839b9 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:14.000893 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42c97f6b-783e-452b-a3dc-398a834839b9 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:14.001380 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42c97f6b-783e-452b-a3dc-398a834839b9 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:14.001819 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42c97f6b-783e-452b-a3dc-398a834839b9 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:14.002645 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42c97f6b-783e-452b-a3dc-398a834839b9 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:14.003426 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42c97f6b-783e-452b-a3dc-398a834839b9 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:14.003861 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42c97f6b-783e-452b-a3dc-398a834839b9 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:14.144953 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-42c97f6b-783e-452b-a3dc-398a834839b9 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:14.153044 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-42c97f6b-783e-452b-a3dc-398a834839b9 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.163085 Sep 17 21:18:14.153606 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 586/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:13 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:18:15.176301 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1e8e31f-dadb-4429-b4b6-b611558fea8c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:15.176943 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1e8e31f-dadb-4429-b4b6-b611558fea8c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:15.183297 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8e31f-dadb-4429-b4b6-b611558fea8c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:15.183770 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8e31f-dadb-4429-b4b6-b611558fea8c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:15.184223 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8e31f-dadb-4429-b4b6-b611558fea8c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:15.184938 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8e31f-dadb-4429-b4b6-b611558fea8c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:15.185388 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8e31f-dadb-4429-b4b6-b611558fea8c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:15.185808 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8e31f-dadb-4429-b4b6-b611558fea8c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:15.330689 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1e8e31f-dadb-4429-b4b6-b611558fea8c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:15.338850 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1e8e31f-dadb-4429-b4b6-b611558fea8c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.166928 Sep 17 21:18:15.339401 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 618/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:15 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:16.362655 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdfbfb73-3668-4cde-87e3-d4a25dc2b6c4 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:16.363260 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cdfbfb73-3668-4cde-87e3-d4a25dc2b6c4 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:16.369647 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdfbfb73-3668-4cde-87e3-d4a25dc2b6c4 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:16.370162 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdfbfb73-3668-4cde-87e3-d4a25dc2b6c4 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:16.370598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdfbfb73-3668-4cde-87e3-d4a25dc2b6c4 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:16.371284 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdfbfb73-3668-4cde-87e3-d4a25dc2b6c4 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:16.371767 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdfbfb73-3668-4cde-87e3-d4a25dc2b6c4 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:16.372189 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdfbfb73-3668-4cde-87e3-d4a25dc2b6c4 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:16.514270 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cdfbfb73-3668-4cde-87e3-d4a25dc2b6c4 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:16.522490 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cdfbfb73-3668-4cde-87e3-d4a25dc2b6c4 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.163895 Sep 17 21:18:16.523047 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 587/1205] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:16 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:17.545195 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-001e922a-9c98-4fba-b9a7-b84c01b9b124 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:17.545802 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-001e922a-9c98-4fba-b9a7-b84c01b9b124 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:17.552301 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-001e922a-9c98-4fba-b9a7-b84c01b9b124 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:17.552817 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-001e922a-9c98-4fba-b9a7-b84c01b9b124 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:17.553254 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-001e922a-9c98-4fba-b9a7-b84c01b9b124 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:17.553948 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-001e922a-9c98-4fba-b9a7-b84c01b9b124 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:17.554402 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-001e922a-9c98-4fba-b9a7-b84c01b9b124 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:17.554831 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-001e922a-9c98-4fba-b9a7-b84c01b9b124 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:17.695717 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-001e922a-9c98-4fba-b9a7-b84c01b9b124 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:17.703862 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-001e922a-9c98-4fba-b9a7-b84c01b9b124 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.162605 Sep 17 21:18:17.704419 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 619/1206] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:17 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:18.728010 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a2a1f94-0660-4fa3-acf3-da3ba0b4191f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:18.728621 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a2a1f94-0660-4fa3-acf3-da3ba0b4191f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:18.734932 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a2a1f94-0660-4fa3-acf3-da3ba0b4191f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:18.735413 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a2a1f94-0660-4fa3-acf3-da3ba0b4191f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:18.735848 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a2a1f94-0660-4fa3-acf3-da3ba0b4191f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:18.736539 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a2a1f94-0660-4fa3-acf3-da3ba0b4191f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:18.737028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a2a1f94-0660-4fa3-acf3-da3ba0b4191f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:18.737446 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a2a1f94-0660-4fa3-acf3-da3ba0b4191f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:18.879773 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a2a1f94-0660-4fa3-acf3-da3ba0b4191f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:18.887860 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a2a1f94-0660-4fa3-acf3-da3ba0b4191f tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.163700 Sep 17 21:18:18.888419 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 588/1207] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:18 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:19.912370 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1049d46-f8c4-4d61-93f2-e226fe78a263 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:19.913144 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d1049d46-f8c4-4d61-93f2-e226fe78a263 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:19.919903 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1049d46-f8c4-4d61-93f2-e226fe78a263 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:19.920660 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1049d46-f8c4-4d61-93f2-e226fe78a263 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:19.923076 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1049d46-f8c4-4d61-93f2-e226fe78a263 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:19.923870 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1049d46-f8c4-4d61-93f2-e226fe78a263 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:19.925007 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1049d46-f8c4-4d61-93f2-e226fe78a263 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:19.925614 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1049d46-f8c4-4d61-93f2-e226fe78a263 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:20.076765 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-d1049d46-f8c4-4d61-93f2-e226fe78a263 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:20.085955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d1049d46-f8c4-4d61-93f2-e226fe78a263 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.178123 Sep 17 21:18:20.086708 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 620/1208] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:19 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:21.110226 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63ebf2ec-7364-4d5d-b4bb-ab9ceadf04d2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:21.110833 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63ebf2ec-7364-4d5d-b4bb-ab9ceadf04d2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:21.117949 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63ebf2ec-7364-4d5d-b4bb-ab9ceadf04d2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:21.118428 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63ebf2ec-7364-4d5d-b4bb-ab9ceadf04d2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:21.118889 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63ebf2ec-7364-4d5d-b4bb-ab9ceadf04d2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:21.119613 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63ebf2ec-7364-4d5d-b4bb-ab9ceadf04d2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:21.120065 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63ebf2ec-7364-4d5d-b4bb-ab9ceadf04d2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:21.120484 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63ebf2ec-7364-4d5d-b4bb-ab9ceadf04d2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:21.270263 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-63ebf2ec-7364-4d5d-b4bb-ab9ceadf04d2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:21.279057 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63ebf2ec-7364-4d5d-b4bb-ab9ceadf04d2 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.172358 Sep 17 21:18:21.279519 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 589/1209] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:21 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:22.302408 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cff2fead-655f-4a21-b580-deee9cf8ff34 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:22.303021 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cff2fead-655f-4a21-b580-deee9cf8ff34 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:22.309601 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cff2fead-655f-4a21-b580-deee9cf8ff34 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:22.310084 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cff2fead-655f-4a21-b580-deee9cf8ff34 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:22.310517 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cff2fead-655f-4a21-b580-deee9cf8ff34 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:22.311215 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cff2fead-655f-4a21-b580-deee9cf8ff34 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:22.311668 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cff2fead-655f-4a21-b580-deee9cf8ff34 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:22.312349 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cff2fead-655f-4a21-b580-deee9cf8ff34 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:22.454895 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-cff2fead-655f-4a21-b580-deee9cf8ff34 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:22.463689 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cff2fead-655f-4a21-b580-deee9cf8ff34 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.165420 Sep 17 21:18:22.464248 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 621/1210] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:22 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:23.486389 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9fb51fd9-ae02-4e2b-9ae8-17f59a87db3b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:23.487149 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9fb51fd9-ae02-4e2b-9ae8-17f59a87db3b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:23.493542 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fb51fd9-ae02-4e2b-9ae8-17f59a87db3b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:23.494030 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fb51fd9-ae02-4e2b-9ae8-17f59a87db3b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:23.494477 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fb51fd9-ae02-4e2b-9ae8-17f59a87db3b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:23.495167 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fb51fd9-ae02-4e2b-9ae8-17f59a87db3b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:23.495625 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fb51fd9-ae02-4e2b-9ae8-17f59a87db3b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:23.496049 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fb51fd9-ae02-4e2b-9ae8-17f59a87db3b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:23.638121 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9fb51fd9-ae02-4e2b-9ae8-17f59a87db3b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:23.646987 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9fb51fd9-ae02-4e2b-9ae8-17f59a87db3b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.164431 Sep 17 21:18:23.647491 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 590/1211] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:23 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:24.670378 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b217f7d-083c-428d-8919-855f9d9a5c40 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:24.671019 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0b217f7d-083c-428d-8919-855f9d9a5c40 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:24.678090 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b217f7d-083c-428d-8919-855f9d9a5c40 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:24.678570 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b217f7d-083c-428d-8919-855f9d9a5c40 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:24.679004 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b217f7d-083c-428d-8919-855f9d9a5c40 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:24.679697 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b217f7d-083c-428d-8919-855f9d9a5c40 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:24.680153 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b217f7d-083c-428d-8919-855f9d9a5c40 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:24.680576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b217f7d-083c-428d-8919-855f9d9a5c40 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:24.820434 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-0b217f7d-083c-428d-8919-855f9d9a5c40 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:24.828545 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0b217f7d-083c-428d-8919-855f9d9a5c40 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.162063 Sep 17 21:18:24.829132 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 622/1212] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:24 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:25.852184 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67c0dc6e-5474-47c0-bfac-034ea09f2942 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:25.852825 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-67c0dc6e-5474-47c0-bfac-034ea09f2942 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:25.859353 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c0dc6e-5474-47c0-bfac-034ea09f2942 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:25.859865 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c0dc6e-5474-47c0-bfac-034ea09f2942 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:25.860294 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c0dc6e-5474-47c0-bfac-034ea09f2942 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:25.861042 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c0dc6e-5474-47c0-bfac-034ea09f2942 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:25.861489 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c0dc6e-5474-47c0-bfac-034ea09f2942 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:25.861904 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c0dc6e-5474-47c0-bfac-034ea09f2942 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:26.003739 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-67c0dc6e-5474-47c0-bfac-034ea09f2942 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:26.012011 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-67c0dc6e-5474-47c0-bfac-034ea09f2942 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.163635 Sep 17 21:18:26.012570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 591/1213] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:25 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:27.035054 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-029dcb12-a1d6-4b14-9049-3ffcd8c8f544 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:27.035667 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-029dcb12-a1d6-4b14-9049-3ffcd8c8f544 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:27.042131 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-029dcb12-a1d6-4b14-9049-3ffcd8c8f544 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:27.042508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-029dcb12-a1d6-4b14-9049-3ffcd8c8f544 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:27.043142 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-029dcb12-a1d6-4b14-9049-3ffcd8c8f544 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:27.043842 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-029dcb12-a1d6-4b14-9049-3ffcd8c8f544 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:27.044297 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-029dcb12-a1d6-4b14-9049-3ffcd8c8f544 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:27.044740 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-029dcb12-a1d6-4b14-9049-3ffcd8c8f544 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:27.192012 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-029dcb12-a1d6-4b14-9049-3ffcd8c8f544 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:27.200226 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-029dcb12-a1d6-4b14-9049-3ffcd8c8f544 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1758 microversion: 2.1 time: 0.169145 Sep 17 21:18:27.200807 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 623/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:27 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:28.224435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6089273-9d67-4062-9c28-dd2e33a5460c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:28.224435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d6089273-9d67-4062-9c28-dd2e33a5460c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:28.231073 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6089273-9d67-4062-9c28-dd2e33a5460c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:28.231570 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6089273-9d67-4062-9c28-dd2e33a5460c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:28.232007 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6089273-9d67-4062-9c28-dd2e33a5460c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:28.232785 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6089273-9d67-4062-9c28-dd2e33a5460c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:28.233332 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6089273-9d67-4062-9c28-dd2e33a5460c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:28.233873 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6089273-9d67-4062-9c28-dd2e33a5460c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:28.391661 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d6089273-9d67-4062-9c28-dd2e33a5460c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:28.401104 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6089273-9d67-4062-9c28-dd2e33a5460c tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1761 microversion: 2.1 time: 0.181493 Sep 17 21:18:28.401648 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 592/1215] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:28 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1761 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:19:31.717235 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=16 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:31.717980 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=48 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:31.719298 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:19:31.719432 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Sat Sep 17 21:19:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/action (ip 10.222.0.16) !!! Sep 17 21:19:31.724582 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c14ce3f3-d8fd-4ab2-9fa5-53d43e532d16 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1622856418"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:31.725132 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c14ce3f3-d8fd-4ab2-9fa5-53d43e532d16 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:31.733265 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c14ce3f3-d8fd-4ab2-9fa5-53d43e532d16 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:31.733743 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c14ce3f3-d8fd-4ab2-9fa5-53d43e532d16 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:31.734174 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c14ce3f3-d8fd-4ab2-9fa5-53d43e532d16 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:31.734860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c14ce3f3-d8fd-4ab2-9fa5-53d43e532d16 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:31.735308 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c14ce3f3-d8fd-4ab2-9fa5-53d43e532d16 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:31.735725 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c14ce3f3-d8fd-4ab2-9fa5-53d43e532d16 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:32.017508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.network.security_group_api [None req-c14ce3f3-d8fd-4ab2-9fa5-53d43e532d16 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Removing security group 4ad3dd1d-26bf-4f76-af0f-78372790e408 from port 1cb82103-f71c-4280-8b52-006d0dc82f48 Sep 17 21:19:32.318422 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c14ce3f3-d8fd-4ab2-9fa5-53d43e532d16 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "POST /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/action" status: 202 len: 0 microversion: 2.1 time: 0.602713 Sep 17 21:19:32.319411 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 624/1216] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 17 21:19:31 2022] POST /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:19:32.327030 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c37a5719-d57d-4362-a347-153ddb2d684a req-aaf04df5-3744-4b3e-8a3a-5e2bdcb523cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb470a89-d7ed-49bd-b7d0-1141d8410aeb", "tag": "1cb82103-f71c-4280-8b52-006d0dc82f48"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:32.337465 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=18 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:32.338160 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:32.338870 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:19:32.339340 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Sat Sep 17 21:19:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 17 21:19:32.341580 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:19:32.341735 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Sat Sep 17 21:19:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 17 21:19:32.344933 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c37a5719-d57d-4362-a347-153ddb2d684a req-aaf04df5-3744-4b3e-8a3a-5e2bdcb523cd service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:32.345435 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c37a5719-d57d-4362-a347-153ddb2d684a req-aaf04df5-3744-4b3e-8a3a-5e2bdcb523cd service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:32.345859 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c37a5719-d57d-4362-a347-153ddb2d684a req-aaf04df5-3744-4b3e-8a3a-5e2bdcb523cd service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:32.376732 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c37a5719-d57d-4362-a347-153ddb2d684a req-aaf04df5-3744-4b3e-8a3a-5e2bdcb523cd service nova] Creating event network-changed:1cb82103-f71c-4280-8b52-006d0dc82f48 for instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb on hv-cinder-82651 Sep 17 21:19:32.384090 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c37a5719-d57d-4362-a347-153ddb2d684a req-aaf04df5-3744-4b3e-8a3a-5e2bdcb523cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061269 Sep 17 21:19:32.385369 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 593/1217] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:33.643189 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa106dbc-e30d-475b-b5df-6fff9c15c0dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:33.644258 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fa106dbc-e30d-475b-b5df-6fff9c15c0dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:33.650504 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa106dbc-e30d-475b-b5df-6fff9c15c0dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:33.651060 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa106dbc-e30d-475b-b5df-6fff9c15c0dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:33.651626 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa106dbc-e30d-475b-b5df-6fff9c15c0dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:33.652386 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa106dbc-e30d-475b-b5df-6fff9c15c0dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:33.652874 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa106dbc-e30d-475b-b5df-6fff9c15c0dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:33.653302 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa106dbc-e30d-475b-b5df-6fff9c15c0dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:33.737946 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-fa106dbc-e30d-475b-b5df-6fff9c15c0dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lazy-loading 'services' on Instance uuid cb470a89-d7ed-49bd-b7d0-1141d8410aeb {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:19:33.818647 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa106dbc-e30d-475b-b5df-6fff9c15c0dd tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments/f3849dc0-590c-4d28-9d36-5274e0cf34a6" status: 202 len: 0 microversion: 2.1 time: 0.180046 Sep 17 21:19:33.819239 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 625/1218] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 17 21:19:33 2022] DELETE /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments/f3849dc0-590c-4d28-9d36-5274e0cf34a6 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:19:33.828168 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-870f16e2-ab0d-4948-853c-ce25f2126b00 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:33.830431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-870f16e2-ab0d-4948-853c-ce25f2126b00 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:33.839103 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-870f16e2-ab0d-4948-853c-ce25f2126b00 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:33.839586 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-870f16e2-ab0d-4948-853c-ce25f2126b00 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:33.840022 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-870f16e2-ab0d-4948-853c-ce25f2126b00 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:33.840743 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-870f16e2-ab0d-4948-853c-ce25f2126b00 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:33.841197 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-870f16e2-ab0d-4948-853c-ce25f2126b00 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:33.841620 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-870f16e2-ab0d-4948-853c-ce25f2126b00 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:33.871031 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-870f16e2-ab0d-4948-853c-ce25f2126b00 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047222 Sep 17 21:19:33.871589 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 594/1219] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:19:33 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:34.403037 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-99cd479b-f4cc-4a40-8776-f92579ee9f25 req-26fa0784-c42d-4ecd-837b-1dd345958b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb470a89-d7ed-49bd-b7d0-1141d8410aeb", "tag": "1cb82103-f71c-4280-8b52-006d0dc82f48"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:34.413176 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-99cd479b-f4cc-4a40-8776-f92579ee9f25 req-26fa0784-c42d-4ecd-837b-1dd345958b41 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:34.413651 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-99cd479b-f4cc-4a40-8776-f92579ee9f25 req-26fa0784-c42d-4ecd-837b-1dd345958b41 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:34.414079 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-99cd479b-f4cc-4a40-8776-f92579ee9f25 req-26fa0784-c42d-4ecd-837b-1dd345958b41 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:34.428862 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-99cd479b-f4cc-4a40-8776-f92579ee9f25 req-26fa0784-c42d-4ecd-837b-1dd345958b41 service nova] Creating event network-changed:1cb82103-f71c-4280-8b52-006d0dc82f48 for instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb on hv-cinder-82651 Sep 17 21:19:34.434150 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-99cd479b-f4cc-4a40-8776-f92579ee9f25 req-26fa0784-c42d-4ecd-837b-1dd345958b41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035117 Sep 17 21:19:34.434750 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 626/1220] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:34.883966 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a7414bd-06b3-475e-9144-6ef103139f60 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:34.886120 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a7414bd-06b3-475e-9144-6ef103139f60 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:34.892516 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a7414bd-06b3-475e-9144-6ef103139f60 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:34.893040 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a7414bd-06b3-475e-9144-6ef103139f60 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:34.893482 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a7414bd-06b3-475e-9144-6ef103139f60 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:34.894171 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a7414bd-06b3-475e-9144-6ef103139f60 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:34.894627 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a7414bd-06b3-475e-9144-6ef103139f60 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:34.895046 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a7414bd-06b3-475e-9144-6ef103139f60 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:34.927644 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a7414bd-06b3-475e-9144-6ef103139f60 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047744 Sep 17 21:19:34.929042 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 595/1221] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:19:34 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:35.941189 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b9c429d-3148-4514-bc2a-660bb8c2e32b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:35.943417 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8b9c429d-3148-4514-bc2a-660bb8c2e32b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:35.949578 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b9c429d-3148-4514-bc2a-660bb8c2e32b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:35.950061 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b9c429d-3148-4514-bc2a-660bb8c2e32b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:35.950501 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b9c429d-3148-4514-bc2a-660bb8c2e32b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:35.951188 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b9c429d-3148-4514-bc2a-660bb8c2e32b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:35.951641 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b9c429d-3148-4514-bc2a-660bb8c2e32b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:35.952066 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b9c429d-3148-4514-bc2a-660bb8c2e32b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:35.980555 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b9c429d-3148-4514-bc2a-660bb8c2e32b tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044489 Sep 17 21:19:35.981126 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 627/1222] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 17 21:19:35 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:19:35.991756 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09526f20-2c30-4730-bd02-09843c6b4baf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:35.992236 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09526f20-2c30-4730-bd02-09843c6b4baf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:35.998540 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09526f20-2c30-4730-bd02-09843c6b4baf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:35.999024 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09526f20-2c30-4730-bd02-09843c6b4baf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:35.999454 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09526f20-2c30-4730-bd02-09843c6b4baf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:36.000140 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09526f20-2c30-4730-bd02-09843c6b4baf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:36.000590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09526f20-2c30-4730-bd02-09843c6b4baf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:36.001067 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09526f20-2c30-4730-bd02-09843c6b4baf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:36.172042 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-09526f20-2c30-4730-bd02-09843c6b4baf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] HTTP exception thrown: Instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb is not attached to volume f3849dc0-590c-4d28-9d36-5274e0cf34a6 Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09526f20-2c30-4730-bd02-09843c6b4baf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Request method failure captured: Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments/f3849dc0-590c-4d28-9d36-5274e0cf34a6 HTTP/1.1 Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjjjEuS9G2iEyLmcOlm3DVR8jSIJTLv-wBjjHt__7EtF90ZN6vjldUjWreUb-BaN3hK4S48u0xEdcU3mJ1mo23BuMy9hlnC2wGip5iDpGiort5oUNmCUig2vx8jI-OWRen72fEOnfVmMylWZ18SPOXNRdGVrCTzbbcbU3p9bat-kAwo Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: 84fb17d896e344aa8c871bf741305304 Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-TestMinimumBasicScenario-394423799 Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:19:36.181242 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:19:36.183045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84fb17d896e344aa8c871bf741305304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84fb17d896e344aa8c871bf741305304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84fb17d896e344aa8c871bf741305304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84fb17d896e344aa8c871bf741305304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:19:36.183045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-TestMinimumBasicScenario-394423799 Sep 17 21:19:36.183045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 84fb17d896e344aa8c871bf741305304 Sep 17 21:19:36.183045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestMinimumBasicScenario-394423799 Sep 17 21:19:36.183045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-TestMinimumBasicScenario-394423799-project Sep 17 21:19:36.183045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:19:36.183045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:19:36.183045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: d4d5d6a240fc4dfba9bc0ced8db6d1e8 Sep 17 21:19:36.183045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-TestMinimumBasicScenario-394423799-project Sep 17 21:19:36.183045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:19:36.183045 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb is not attached to volume f3849dc0-590c-4d28-9d36-5274e0cf34a6 Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'server_id': 'cb470a89-d7ed-49bd-b7d0-1141d8410aeb', 'id': 'f3849dc0-590c-4d28-9d36-5274e0cf34a6'} Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f3849dc0-590c-4d28-9d36-5274e0cf34a6. Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:19:36.184038 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb is not attached to volume f3849dc0-590c-4d28-9d36-5274e0cf34a6 Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb is not attached to volume f3849dc0-590c-4d28-9d36-5274e0cf34a6 Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:19:36.185981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09526f20-2c30-4730-bd02-09843c6b4baf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Returning 404 to user: Instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb is not attached to volume f3849dc0-590c-4d28-9d36-5274e0cf34a6 {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:19:36.187277 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09526f20-2c30-4730-bd02-09843c6b4baf tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments/f3849dc0-590c-4d28-9d36-5274e0cf34a6" status: 404 len: 154 microversion: 2.1 time: 0.194916 Sep 17 21:19:36.187277 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 596/1223] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 17 21:19:35 2022] DELETE /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb/os-volume_attachments/f3849dc0-590c-4d28-9d36-5274e0cf34a6 => generated 154 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:19:37.324766 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dcfeba16-4528-4e75-b25b-f2cada7c9467 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:37.325626 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dcfeba16-4528-4e75-b25b-f2cada7c9467 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:37.332127 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcfeba16-4528-4e75-b25b-f2cada7c9467 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:37.332630 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcfeba16-4528-4e75-b25b-f2cada7c9467 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:37.333092 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcfeba16-4528-4e75-b25b-f2cada7c9467 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:37.333780 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcfeba16-4528-4e75-b25b-f2cada7c9467 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:37.334230 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcfeba16-4528-4e75-b25b-f2cada7c9467 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:37.334647 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcfeba16-4528-4e75-b25b-f2cada7c9467 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:37.358730 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dcfeba16-4528-4e75-b25b-f2cada7c9467 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:19:37.431640 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dcfeba16-4528-4e75-b25b-f2cada7c9467 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 204 len: 0 microversion: 2.1 time: 0.110603 Sep 17 21:19:37.432212 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 628/1224] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:19:37 2022] DELETE /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:19:37.440489 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2a3befe8-1645-4cb5-b874-93ef39df83a7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:37.441266 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2a3befe8-1645-4cb5-b874-93ef39df83a7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:37.447459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a3befe8-1645-4cb5-b874-93ef39df83a7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:37.447931 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a3befe8-1645-4cb5-b874-93ef39df83a7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:37.448355 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a3befe8-1645-4cb5-b874-93ef39df83a7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:37.449076 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a3befe8-1645-4cb5-b874-93ef39df83a7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:37.449521 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a3befe8-1645-4cb5-b874-93ef39df83a7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:37.449936 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a3befe8-1645-4cb5-b874-93ef39df83a7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:37.579302 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a3befe8-1645-4cb5-b874-93ef39df83a7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:37.586844 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2a3befe8-1645-4cb5-b874-93ef39df83a7 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1555 microversion: 2.1 time: 0.150165 Sep 17 21:19:37.587414 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 597/1225] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:37 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:38.611265 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85ec673a-b7aa-48e3-b907-73f3f5901cc6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:38.611895 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85ec673a-b7aa-48e3-b907-73f3f5901cc6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:38.618452 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85ec673a-b7aa-48e3-b907-73f3f5901cc6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:38.618934 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85ec673a-b7aa-48e3-b907-73f3f5901cc6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:38.619368 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85ec673a-b7aa-48e3-b907-73f3f5901cc6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:38.620060 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85ec673a-b7aa-48e3-b907-73f3f5901cc6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:38.620511 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85ec673a-b7aa-48e3-b907-73f3f5901cc6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:38.620968 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85ec673a-b7aa-48e3-b907-73f3f5901cc6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:38.752694 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-85ec673a-b7aa-48e3-b907-73f3f5901cc6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:38.760975 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85ec673a-b7aa-48e3-b907-73f3f5901cc6 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1555 microversion: 2.1 time: 0.153982 Sep 17 21:19:38.761594 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 629/1226] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:38 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:39.785968 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e0d802d8-0a9b-4c15-ac83-d2859b6b7496 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:39.786590 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e0d802d8-0a9b-4c15-ac83-d2859b6b7496 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:39.793273 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0d802d8-0a9b-4c15-ac83-d2859b6b7496 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:39.793757 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0d802d8-0a9b-4c15-ac83-d2859b6b7496 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:39.794408 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0d802d8-0a9b-4c15-ac83-d2859b6b7496 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:39.795126 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0d802d8-0a9b-4c15-ac83-d2859b6b7496 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:39.795579 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0d802d8-0a9b-4c15-ac83-d2859b6b7496 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:39.796004 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0d802d8-0a9b-4c15-ac83-d2859b6b7496 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:39.905358 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e0d802d8-0a9b-4c15-ac83-d2859b6b7496 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d5d6a240fc4dfba9bc0ced8db6d1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fb17d896e344aa8c871bf741305304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:39.914956 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e0d802d8-0a9b-4c15-ac83-d2859b6b7496 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 200 len: 1513 microversion: 2.1 time: 0.133421 Sep 17 21:19:39.915654 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 598/1227] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:39 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 1513 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:39.921775 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-01eb9494-5a5b-45a5-8fc5-9c1830f07ef3 req-ccd6003c-d324-442b-bf0d-96e391da3836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb470a89-d7ed-49bd-b7d0-1141d8410aeb", "name": "network-vif-deleted", "tag": "1cb82103-f71c-4280-8b52-006d0dc82f48"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:39.932398 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-01eb9494-5a5b-45a5-8fc5-9c1830f07ef3 req-ccd6003c-d324-442b-bf0d-96e391da3836 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:39.933011 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-01eb9494-5a5b-45a5-8fc5-9c1830f07ef3 req-ccd6003c-d324-442b-bf0d-96e391da3836 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:39.933566 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-01eb9494-5a5b-45a5-8fc5-9c1830f07ef3 req-ccd6003c-d324-442b-bf0d-96e391da3836 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:39.945976 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-01eb9494-5a5b-45a5-8fc5-9c1830f07ef3 req-ccd6003c-d324-442b-bf0d-96e391da3836 service nova] Creating event network-vif-deleted:1cb82103-f71c-4280-8b52-006d0dc82f48 for instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb on hv-cinder-82651 Sep 17 21:19:39.951200 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-01eb9494-5a5b-45a5-8fc5-9c1830f07ef3 req-ccd6003c-d324-442b-bf0d-96e391da3836 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032974 Sep 17 21:19:39.951795 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 630/1228] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:40.938744 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-176f7d8d-d720-4d26-bf67-0517427bac8d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:40.939376 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-176f7d8d-d720-4d26-bf67-0517427bac8d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] [instance: cb470a89-d7ed-49bd-b7d0-1141d8410aeb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:40.945881 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-176f7d8d-d720-4d26-bf67-0517427bac8d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:40.946356 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-176f7d8d-d720-4d26-bf67-0517427bac8d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:40.946785 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-176f7d8d-d720-4d26-bf67-0517427bac8d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:40.947463 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-176f7d8d-d720-4d26-bf67-0517427bac8d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:40.947916 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-176f7d8d-d720-4d26-bf67-0517427bac8d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:40.948359 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-176f7d8d-d720-4d26-bf67-0517427bac8d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:40.961459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-176f7d8d-d720-4d26-bf67-0517427bac8d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] HTTP exception thrown: Instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb could not be found. Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-176f7d8d-d720-4d26-bf67-0517427bac8d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Request method failure captured: Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb HTTP/1.1 Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjjjEuS9G2iEyLmcOlm3DVR8jSIJTLv-wBjjHt__7EtF90ZN6vjldUjWreUb-BaN3hK4S48u0xEdcU3mJ1mo23BuMy9hlnC2wGip5iDpGiort5oUNmCUig2vx8jI-OWRen72fEOnfVmMylWZ18SPOXNRdGVrCTzbbcbU3p9bat-kAwo Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: 84fb17d896e344aa8c871bf741305304 Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-TestMinimumBasicScenario-394423799 Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:19:40.962957 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:19:40.964665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84fb17d896e344aa8c871bf741305304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84fb17d896e344aa8c871bf741305304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84fb17d896e344aa8c871bf741305304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84fb17d896e344aa8c871bf741305304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:19:40.964665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-TestMinimumBasicScenario-394423799 Sep 17 21:19:40.964665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 84fb17d896e344aa8c871bf741305304 Sep 17 21:19:40.964665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestMinimumBasicScenario-394423799 Sep 17 21:19:40.964665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-TestMinimumBasicScenario-394423799-project Sep 17 21:19:40.964665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:19:40.964665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:19:40.964665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: d4d5d6a240fc4dfba9bc0ced8db6d1e8 Sep 17 21:19:40.964665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-TestMinimumBasicScenario-394423799-project Sep 17 21:19:40.964665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:19:40.964665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb could not be found. Sep 17 21:19:40.964665 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': 'cb470a89-d7ed-49bd-b7d0-1141d8410aeb'} Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb could not be found. Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:19:40.965611 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb could not be found. Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb could not be found. Sep 17 21:19:40.966964 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:19:40.968315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-176f7d8d-d720-4d26-bf67-0517427bac8d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Returning 404 to user: Instance cb470a89-d7ed-49bd-b7d0-1141d8410aeb could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:19:40.968315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-176f7d8d-d720-4d26-bf67-0517427bac8d tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb" status: 404 len: 111 microversion: 2.1 time: 0.029701 Sep 17 21:19:40.968315 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 599/1229] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:40 2022] GET /compute/v2.1/servers/cb470a89-d7ed-49bd-b7d0-1141d8410aeb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:19:40.974678 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a69da926-de35-424a-b288-f05ed68559f5 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] Calling method '.version_select at 0x7f9ba751bee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:40.995827 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a69da926-de35-424a-b288-f05ed68559f5 tempest-TestMinimumBasicScenario-394423799 tempest-TestMinimumBasicScenario-394423799-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2020521357" status: 202 len: 0 microversion: 2.1 time: 0.026455 Sep 17 21:19:40.996406 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 631/1230] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 17 21:19:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2020521357 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:19:50.729581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-217697115", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-70796160", "security_groups": [{"name": "tempest-secgroup-smoke-1359094004"}], "block_device_mapping_v2": [{"uuid": "c027ff43-7f13-4bf1-9530-2eff200b7b7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "39daaa91-156d-400a-8598-b2da78c5f62e"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:50.842842 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] validate_networks() for [('39daaa91-156d-400a-8598-b2da78c5f62e', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:19:50.957097 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=34 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:51.204601 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:19:51.205047 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:19:51.205562 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:19:51.206019 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:19:51.206466 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:19:51.214920 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:51.215395 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:51.215822 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:51.216536 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:51.217023 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:51.217441 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:51.234289 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Getting quotas for project f58304cb0e1a42ce9bbc5ea8a3e58899. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:19:51.238851 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Getting quotas for user 91f2a01f833d4751a6f81d6a8f11b8ed and project f58304cb0e1a42ce9bbc5ea8a3e58899. Resources: {'instances', 'ram', 'cores'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:19:51.294356 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:19:51.296443 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c027ff43-7f13-4bf1-9530-2eff200b7b7b',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:19:51.422667 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09bd9524-fcc5-4e56-87ab-fdc51f830683 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.696860 Sep 17 21:19:51.423604 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 600/1231] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 17 21:19:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:19:51.432362 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:51.433282 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:51.437379 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1138fe2-145f-4454-8273-a1c59a5beec5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:51.438099 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b1138fe2-145f-4454-8273-a1c59a5beec5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:51.497705 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-b1138fe2-145f-4454-8273-a1c59a5beec5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:51.505068 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b1138fe2-145f-4454-8273-a1c59a5beec5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1092 microversion: 2.1 time: 0.074128 Sep 17 21:19:51.505583 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 632/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:51 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1092 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:52.528265 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2028f65-f488-484c-b073-a654fca48cce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:52.529602 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b2028f65-f488-484c-b073-a654fca48cce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:52.536861 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2028f65-f488-484c-b073-a654fca48cce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:52.537431 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2028f65-f488-484c-b073-a654fca48cce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:52.537945 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2028f65-f488-484c-b073-a654fca48cce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:52.538706 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2028f65-f488-484c-b073-a654fca48cce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:52.539224 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2028f65-f488-484c-b073-a654fca48cce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:52.539709 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2028f65-f488-484c-b073-a654fca48cce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:52.645856 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2028f65-f488-484c-b073-a654fca48cce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:52.654044 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b2028f65-f488-484c-b073-a654fca48cce tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1208 microversion: 2.1 time: 0.130583 Sep 17 21:19:52.654598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 601/1233] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:52 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1208 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:53.678689 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-defd72a0-3aef-4611-bc68-07c8037f6cda tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:53.679382 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-defd72a0-3aef-4611-bc68-07c8037f6cda tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:53.686243 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-defd72a0-3aef-4611-bc68-07c8037f6cda tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:53.686721 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-defd72a0-3aef-4611-bc68-07c8037f6cda tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:53.687313 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-defd72a0-3aef-4611-bc68-07c8037f6cda tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:53.688017 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-defd72a0-3aef-4611-bc68-07c8037f6cda tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:53.688473 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-defd72a0-3aef-4611-bc68-07c8037f6cda tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:53.688920 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-defd72a0-3aef-4611-bc68-07c8037f6cda tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:53.897691 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-defd72a0-3aef-4611-bc68-07c8037f6cda tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:53.904248 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3e34463c-c9be-4da1-84d5-078cf5f97be1 req-b597c5e8-5d97-45c1-9f77-2938c36c092c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5a0302-77e9-48cb-b21d-a3fd09378dab", "tag": "138012db-6b1d-45fb-b75a-dc0d7a40a041"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:53.914690 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-defd72a0-3aef-4611-bc68-07c8037f6cda tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1264 microversion: 2.1 time: 0.240583 Sep 17 21:19:53.916737 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3e34463c-c9be-4da1-84d5-078cf5f97be1 req-b597c5e8-5d97-45c1-9f77-2938c36c092c service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:53.917695 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3e34463c-c9be-4da1-84d5-078cf5f97be1 req-b597c5e8-5d97-45c1-9f77-2938c36c092c service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:53.918121 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3e34463c-c9be-4da1-84d5-078cf5f97be1 req-b597c5e8-5d97-45c1-9f77-2938c36c092c service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:53.928993 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 633/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:53 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1264 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:53.931252 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3e34463c-c9be-4da1-84d5-078cf5f97be1 req-b597c5e8-5d97-45c1-9f77-2938c36c092c service nova] Creating event network-changed:138012db-6b1d-45fb-b75a-dc0d7a40a041 for instance 0d5a0302-77e9-48cb-b21d-a3fd09378dab on hv-cinder-82651 Sep 17 21:19:53.936729 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3e34463c-c9be-4da1-84d5-078cf5f97be1 req-b597c5e8-5d97-45c1-9f77-2938c36c092c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039800 Sep 17 21:19:53.937690 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 602/1235] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:54.940821 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e3bd0d70-317d-424c-802c-1ee8a0b5a218 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:54.941459 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e3bd0d70-317d-424c-802c-1ee8a0b5a218 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:54.947828 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3bd0d70-317d-424c-802c-1ee8a0b5a218 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:54.948308 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3bd0d70-317d-424c-802c-1ee8a0b5a218 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:54.948766 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3bd0d70-317d-424c-802c-1ee8a0b5a218 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:54.949459 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3bd0d70-317d-424c-802c-1ee8a0b5a218 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:54.949913 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3bd0d70-317d-424c-802c-1ee8a0b5a218 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:54.950340 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3bd0d70-317d-424c-802c-1ee8a0b5a218 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:55.080183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-e3bd0d70-317d-424c-802c-1ee8a0b5a218 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:55.088806 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e3bd0d70-317d-424c-802c-1ee8a0b5a218 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1264 microversion: 2.1 time: 0.151783 Sep 17 21:19:55.089382 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 634/1236] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:54 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:56.113111 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-51c401f5-11a2-4dab-aa54-b88357ad4761 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:56.113834 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-51c401f5-11a2-4dab-aa54-b88357ad4761 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:56.120699 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51c401f5-11a2-4dab-aa54-b88357ad4761 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:56.121183 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51c401f5-11a2-4dab-aa54-b88357ad4761 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:56.121617 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51c401f5-11a2-4dab-aa54-b88357ad4761 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:56.122301 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51c401f5-11a2-4dab-aa54-b88357ad4761 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:56.122754 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51c401f5-11a2-4dab-aa54-b88357ad4761 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:56.123176 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51c401f5-11a2-4dab-aa54-b88357ad4761 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:56.256068 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-51c401f5-11a2-4dab-aa54-b88357ad4761 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:56.263597 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-51c401f5-11a2-4dab-aa54-b88357ad4761 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1264 microversion: 2.1 time: 0.155307 Sep 17 21:19:56.264178 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 603/1237] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:56 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:57.286192 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c10ad700-0092-4fb4-9ac4-c2f0011bbc9b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:57.286900 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c10ad700-0092-4fb4-9ac4-c2f0011bbc9b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:57.293427 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c10ad700-0092-4fb4-9ac4-c2f0011bbc9b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:57.293912 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c10ad700-0092-4fb4-9ac4-c2f0011bbc9b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:57.294350 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c10ad700-0092-4fb4-9ac4-c2f0011bbc9b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:57.295054 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c10ad700-0092-4fb4-9ac4-c2f0011bbc9b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:57.295508 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c10ad700-0092-4fb4-9ac4-c2f0011bbc9b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:57.295932 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c10ad700-0092-4fb4-9ac4-c2f0011bbc9b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:57.423360 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-c10ad700-0092-4fb4-9ac4-c2f0011bbc9b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:57.431172 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c10ad700-0092-4fb4-9ac4-c2f0011bbc9b tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1264 microversion: 2.1 time: 0.149397 Sep 17 21:19:57.431732 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 635/1238] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:57 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:58.454213 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a61548e-a4e3-46a0-8721-cd347b69d55d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:58.454822 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a61548e-a4e3-46a0-8721-cd347b69d55d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:58.461968 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a61548e-a4e3-46a0-8721-cd347b69d55d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:58.462446 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a61548e-a4e3-46a0-8721-cd347b69d55d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:58.462879 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a61548e-a4e3-46a0-8721-cd347b69d55d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:58.463562 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a61548e-a4e3-46a0-8721-cd347b69d55d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:58.464014 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a61548e-a4e3-46a0-8721-cd347b69d55d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:58.464460 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a61548e-a4e3-46a0-8721-cd347b69d55d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:58.595175 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a61548e-a4e3-46a0-8721-cd347b69d55d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:58.603508 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a61548e-a4e3-46a0-8721-cd347b69d55d tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1264 microversion: 2.1 time: 0.153124 Sep 17 21:19:58.604064 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 604/1239] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:58 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:59.625930 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba350722-a1f5-4173-94bb-d015fc77c195 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:59.626535 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ba350722-a1f5-4173-94bb-d015fc77c195 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:59.632856 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba350722-a1f5-4173-94bb-d015fc77c195 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:59.633330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba350722-a1f5-4173-94bb-d015fc77c195 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:59.633761 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba350722-a1f5-4173-94bb-d015fc77c195 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:59.634443 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba350722-a1f5-4173-94bb-d015fc77c195 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:59.634891 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba350722-a1f5-4173-94bb-d015fc77c195 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:59.635308 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba350722-a1f5-4173-94bb-d015fc77c195 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:59.762899 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-ba350722-a1f5-4173-94bb-d015fc77c195 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:59.770669 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba350722-a1f5-4173-94bb-d015fc77c195 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1264 microversion: 2.1 time: 0.148556 Sep 17 21:19:59.771217 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 636/1240] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:59 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:00.793301 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ab4da060-1c9c-48b0-934b-7ed04f033853 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:00.793933 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ab4da060-1c9c-48b0-934b-7ed04f033853 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:00.800387 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab4da060-1c9c-48b0-934b-7ed04f033853 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:00.800979 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab4da060-1c9c-48b0-934b-7ed04f033853 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:00.801420 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab4da060-1c9c-48b0-934b-7ed04f033853 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:00.802178 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab4da060-1c9c-48b0-934b-7ed04f033853 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:00.802699 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab4da060-1c9c-48b0-934b-7ed04f033853 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:00.803129 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab4da060-1c9c-48b0-934b-7ed04f033853 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:00.932419 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ab4da060-1c9c-48b0-934b-7ed04f033853 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:00.940430 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ab4da060-1c9c-48b0-934b-7ed04f033853 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1264 microversion: 2.1 time: 0.151142 Sep 17 21:20:00.941029 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 605/1241] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:00 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:01.963916 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f07ce3d-6865-4fce-8ad4-5e12cd030805 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:01.964522 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f07ce3d-6865-4fce-8ad4-5e12cd030805 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:01.966893 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:01.972349 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f07ce3d-6865-4fce-8ad4-5e12cd030805 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:01.972777 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f07ce3d-6865-4fce-8ad4-5e12cd030805 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:01.973241 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f07ce3d-6865-4fce-8ad4-5e12cd030805 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:01.973937 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f07ce3d-6865-4fce-8ad4-5e12cd030805 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:01.974390 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f07ce3d-6865-4fce-8ad4-5e12cd030805 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:01.974812 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f07ce3d-6865-4fce-8ad4-5e12cd030805 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:02.108955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f07ce3d-6865-4fce-8ad4-5e12cd030805 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:02.116862 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f07ce3d-6865-4fce-8ad4-5e12cd030805 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1264 microversion: 2.1 time: 0.156779 Sep 17 21:20:02.117423 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 637/1242] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:01 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:03.139307 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4156d25f-c111-48fd-90e3-a379547dfa9c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:03.140028 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4156d25f-c111-48fd-90e3-a379547dfa9c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:03.142200 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:03.143021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:03.144156 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:03.150262 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4156d25f-c111-48fd-90e3-a379547dfa9c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:03.150741 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4156d25f-c111-48fd-90e3-a379547dfa9c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:03.151172 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4156d25f-c111-48fd-90e3-a379547dfa9c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:03.151858 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4156d25f-c111-48fd-90e3-a379547dfa9c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:03.152306 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4156d25f-c111-48fd-90e3-a379547dfa9c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:03.152743 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4156d25f-c111-48fd-90e3-a379547dfa9c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:03.292626 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4156d25f-c111-48fd-90e3-a379547dfa9c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:03.301157 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4156d25f-c111-48fd-90e3-a379547dfa9c tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1264 microversion: 2.1 time: 0.165597 Sep 17 21:20:03.301726 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 606/1243] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:03 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:04.324200 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da5586ac-6c8d-4077-9c07-414cc146b850 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:04.324840 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da5586ac-6c8d-4077-9c07-414cc146b850 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:04.331813 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da5586ac-6c8d-4077-9c07-414cc146b850 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:04.332313 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da5586ac-6c8d-4077-9c07-414cc146b850 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:04.332774 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da5586ac-6c8d-4077-9c07-414cc146b850 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:04.333479 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da5586ac-6c8d-4077-9c07-414cc146b850 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:04.333919 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da5586ac-6c8d-4077-9c07-414cc146b850 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:04.334345 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da5586ac-6c8d-4077-9c07-414cc146b850 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:04.479062 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-da5586ac-6c8d-4077-9c07-414cc146b850 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:04.488201 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da5586ac-6c8d-4077-9c07-414cc146b850 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1264 microversion: 2.1 time: 0.167868 Sep 17 21:20:04.488846 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 638/1244] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:04 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:04.612940 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-72fa8991-7a01-4eb7-bfaa-fd8c0edf2302 req-0e1bab7d-8aef-4be0-b109-106ccaedd93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5a0302-77e9-48cb-b21d-a3fd09378dab", "name": "network-vif-plugged", "status": "completed", "tag": "138012db-6b1d-45fb-b75a-dc0d7a40a041"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:04.623187 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-72fa8991-7a01-4eb7-bfaa-fd8c0edf2302 req-0e1bab7d-8aef-4be0-b109-106ccaedd93d service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:04.623645 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-72fa8991-7a01-4eb7-bfaa-fd8c0edf2302 req-0e1bab7d-8aef-4be0-b109-106ccaedd93d service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:04.624113 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-72fa8991-7a01-4eb7-bfaa-fd8c0edf2302 req-0e1bab7d-8aef-4be0-b109-106ccaedd93d service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:04.635834 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-72fa8991-7a01-4eb7-bfaa-fd8c0edf2302 req-0e1bab7d-8aef-4be0-b109-106ccaedd93d service nova] Creating event network-vif-plugged:138012db-6b1d-45fb-b75a-dc0d7a40a041 for instance 0d5a0302-77e9-48cb-b21d-a3fd09378dab on hv-cinder-82651 Sep 17 21:20:04.640857 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-72fa8991-7a01-4eb7-bfaa-fd8c0edf2302 req-0e1bab7d-8aef-4be0-b109-106ccaedd93d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031672 Sep 17 21:20:04.641687 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 607/1245] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:05.511087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa9cac29-5340-4327-b476-052120ee2efb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:05.511700 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fa9cac29-5340-4327-b476-052120ee2efb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:05.518119 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa9cac29-5340-4327-b476-052120ee2efb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:05.519183 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa9cac29-5340-4327-b476-052120ee2efb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:05.519621 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa9cac29-5340-4327-b476-052120ee2efb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:05.520421 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa9cac29-5340-4327-b476-052120ee2efb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:05.520906 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa9cac29-5340-4327-b476-052120ee2efb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:05.521334 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa9cac29-5340-4327-b476-052120ee2efb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:05.647589 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-fa9cac29-5340-4327-b476-052120ee2efb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:05.655186 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa9cac29-5340-4327-b476-052120ee2efb tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1264 microversion: 2.1 time: 0.147974 Sep 17 21:20:05.655743 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 639/1246] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:05 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:06.678759 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d38d29df-d8e2-4eb6-8a87-dd15d7ad3852 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:06.679407 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d38d29df-d8e2-4eb6-8a87-dd15d7ad3852 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:06.685837 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d38d29df-d8e2-4eb6-8a87-dd15d7ad3852 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:06.686328 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d38d29df-d8e2-4eb6-8a87-dd15d7ad3852 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:06.686763 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d38d29df-d8e2-4eb6-8a87-dd15d7ad3852 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:06.687485 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d38d29df-d8e2-4eb6-8a87-dd15d7ad3852 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:06.687943 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d38d29df-d8e2-4eb6-8a87-dd15d7ad3852 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:06.688370 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d38d29df-d8e2-4eb6-8a87-dd15d7ad3852 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:06.821163 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d38d29df-d8e2-4eb6-8a87-dd15d7ad3852 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:06.828756 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d38d29df-d8e2-4eb6-8a87-dd15d7ad3852 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1450 microversion: 2.1 time: 0.154827 Sep 17 21:20:06.829310 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 608/1247] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:06 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:06.851603 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21dd6312-7efb-455e-b1fc-381615ddfc92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:06.852212 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21dd6312-7efb-455e-b1fc-381615ddfc92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:06.858744 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21dd6312-7efb-455e-b1fc-381615ddfc92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:06.859233 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21dd6312-7efb-455e-b1fc-381615ddfc92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:06.859666 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21dd6312-7efb-455e-b1fc-381615ddfc92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:06.860364 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21dd6312-7efb-455e-b1fc-381615ddfc92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:06.860857 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21dd6312-7efb-455e-b1fc-381615ddfc92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:06.861290 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21dd6312-7efb-455e-b1fc-381615ddfc92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:06.989785 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-21dd6312-7efb-455e-b1fc-381615ddfc92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:06.997389 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21dd6312-7efb-455e-b1fc-381615ddfc92 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1450 microversion: 2.1 time: 0.149576 Sep 17 21:20:06.997939 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 640/1248] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:06 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:08.952908 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5fd9e86f-915b-4e16-8f28-cca704e98077 req-8f9a77c7-7bc4-44c4-aa1c-dd794dbdfc7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5a0302-77e9-48cb-b21d-a3fd09378dab", "tag": "138012db-6b1d-45fb-b75a-dc0d7a40a041"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:08.963287 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5fd9e86f-915b-4e16-8f28-cca704e98077 req-8f9a77c7-7bc4-44c4-aa1c-dd794dbdfc7c service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:08.963791 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5fd9e86f-915b-4e16-8f28-cca704e98077 req-8f9a77c7-7bc4-44c4-aa1c-dd794dbdfc7c service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:08.964250 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5fd9e86f-915b-4e16-8f28-cca704e98077 req-8f9a77c7-7bc4-44c4-aa1c-dd794dbdfc7c service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:08.975631 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5fd9e86f-915b-4e16-8f28-cca704e98077 req-8f9a77c7-7bc4-44c4-aa1c-dd794dbdfc7c service nova] Creating event network-changed:138012db-6b1d-45fb-b75a-dc0d7a40a041 for instance 0d5a0302-77e9-48cb-b21d-a3fd09378dab on hv-cinder-82651 Sep 17 21:20:08.980701 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5fd9e86f-915b-4e16-8f28-cca704e98077 req-8f9a77c7-7bc4-44c4-aa1c-dd794dbdfc7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031559 Sep 17 21:20:08.981625 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 609/1249] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:21:58.424651 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed980c17-c84d-46aa-9777-968996353d5e] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 17 21:21:58.425349 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=20 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:58.426251 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=48 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:58.427181 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:21:58.427324 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Sat Sep 17 21:21:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab (ip 10.222.0.16) !!! Sep 17 21:21:58.428363 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2fccf091-e02a-4a7c-90a7-847657f88764] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 21:21:58.428981 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=7 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:58.429696 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=44 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:58.436768 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eb6438ad-a5a5-48db-ae0b-b5256f753211 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:58.437275 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eb6438ad-a5a5-48db-ae0b-b5256f753211 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:58.448839 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb6438ad-a5a5-48db-ae0b-b5256f753211 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:58.449330 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb6438ad-a5a5-48db-ae0b-b5256f753211 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:58.449775 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb6438ad-a5a5-48db-ae0b-b5256f753211 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:58.450488 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb6438ad-a5a5-48db-ae0b-b5256f753211 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:58.450944 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb6438ad-a5a5-48db-ae0b-b5256f753211 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:58.451372 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb6438ad-a5a5-48db-ae0b-b5256f753211 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:58.482691 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eb6438ad-a5a5-48db-ae0b-b5256f753211 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:21:58.568144 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9a6101d1-da5a-4a4a-b8bd-2a13c9c570b1 req-af14e357-35b1-42a3-ade6-97c65a51a2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5a0302-77e9-48cb-b21d-a3fd09378dab", "tag": "138012db-6b1d-45fb-b75a-dc0d7a40a041"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:21:58.571711 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eb6438ad-a5a5-48db-ae0b-b5256f753211 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 204 len: 0 microversion: 2.1 time: 0.149308 Sep 17 21:21:58.572709 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 641/1250] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:21:58 2022] DELETE /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:21:58.581598 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9a6101d1-da5a-4a4a-b8bd-2a13c9c570b1 req-af14e357-35b1-42a3-ade6-97c65a51a2b0 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:58.581905 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4712e99c-adcb-49d9-9d3e-55c6f79786d5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:58.582073 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9a6101d1-da5a-4a4a-b8bd-2a13c9c570b1 req-af14e357-35b1-42a3-ade6-97c65a51a2b0 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:58.582606 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4712e99c-adcb-49d9-9d3e-55c6f79786d5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:58.582736 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9a6101d1-da5a-4a4a-b8bd-2a13c9c570b1 req-af14e357-35b1-42a3-ade6-97c65a51a2b0 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:58.588701 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4712e99c-adcb-49d9-9d3e-55c6f79786d5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:58.589222 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4712e99c-adcb-49d9-9d3e-55c6f79786d5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:58.589658 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4712e99c-adcb-49d9-9d3e-55c6f79786d5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:58.590353 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4712e99c-adcb-49d9-9d3e-55c6f79786d5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:58.590809 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4712e99c-adcb-49d9-9d3e-55c6f79786d5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:58.591234 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4712e99c-adcb-49d9-9d3e-55c6f79786d5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:58.595231 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9a6101d1-da5a-4a4a-b8bd-2a13c9c570b1 req-af14e357-35b1-42a3-ade6-97c65a51a2b0 service nova] Creating event network-changed:138012db-6b1d-45fb-b75a-dc0d7a40a041 for instance 0d5a0302-77e9-48cb-b21d-a3fd09378dab on hv-cinder-82651 Sep 17 21:21:58.600360 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9a6101d1-da5a-4a4a-b8bd-2a13c9c570b1 req-af14e357-35b1-42a3-ade6-97c65a51a2b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174044 Sep 17 21:21:58.601202 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 610/1251] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:21:58.728753 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-4712e99c-adcb-49d9-9d3e-55c6f79786d5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:58.736975 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4712e99c-adcb-49d9-9d3e-55c6f79786d5 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1575 microversion: 2.1 time: 0.159272 Sep 17 21:21:58.737540 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 642/1252] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:58 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:59.762935 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef03e00e-f811-4448-8564-1654705bb8ab tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:59.763629 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ef03e00e-f811-4448-8564-1654705bb8ab tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:59.773211 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef03e00e-f811-4448-8564-1654705bb8ab tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:59.773691 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef03e00e-f811-4448-8564-1654705bb8ab tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:59.774129 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef03e00e-f811-4448-8564-1654705bb8ab tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:59.774820 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef03e00e-f811-4448-8564-1654705bb8ab tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:59.775267 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef03e00e-f811-4448-8564-1654705bb8ab tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:59.775819 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef03e00e-f811-4448-8564-1654705bb8ab tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:59.776513 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] [2fccf091-e02a-4a7c-90a7-847657f88764] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55108. Sep 17 21:21:59.911549 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ef03e00e-f811-4448-8564-1654705bb8ab tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:59.919253 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ef03e00e-f811-4448-8564-1654705bb8ab tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1575 microversion: 2.1 time: 0.162674 Sep 17 21:21:59.919808 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 611/1253] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:59 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:00.654873 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-4793766d-f76c-42d1-b9fe-2ee4d8911797 req-fd83ce05-5b27-41ae-9180-d5c49cdc33bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5a0302-77e9-48cb-b21d-a3fd09378dab", "name": "network-vif-deleted", "tag": "138012db-6b1d-45fb-b75a-dc0d7a40a041"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:00.666874 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4793766d-f76c-42d1-b9fe-2ee4d8911797 req-fd83ce05-5b27-41ae-9180-d5c49cdc33bf service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:00.667355 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4793766d-f76c-42d1-b9fe-2ee4d8911797 req-fd83ce05-5b27-41ae-9180-d5c49cdc33bf service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:00.667788 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4793766d-f76c-42d1-b9fe-2ee4d8911797 req-fd83ce05-5b27-41ae-9180-d5c49cdc33bf service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:00.677955 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed980c17-c84d-46aa-9777-968996353d5e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55112. Sep 17 21:22:00.679914 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-4793766d-f76c-42d1-b9fe-2ee4d8911797 req-fd83ce05-5b27-41ae-9180-d5c49cdc33bf service nova] Creating event network-vif-deleted:138012db-6b1d-45fb-b75a-dc0d7a40a041 for instance 0d5a0302-77e9-48cb-b21d-a3fd09378dab on hv-cinder-82651 Sep 17 21:22:00.684789 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-4793766d-f76c-42d1-b9fe-2ee4d8911797 req-fd83ce05-5b27-41ae-9180-d5c49cdc33bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033535 Sep 17 21:22:00.685365 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 643/1254] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:22:00.943246 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3cb1d077-cff4-4fba-a41d-1db7a78b9dfa tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:00.943866 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3cb1d077-cff4-4fba-a41d-1db7a78b9dfa tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:00.950562 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cb1d077-cff4-4fba-a41d-1db7a78b9dfa tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:00.951114 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cb1d077-cff4-4fba-a41d-1db7a78b9dfa tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:00.951562 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cb1d077-cff4-4fba-a41d-1db7a78b9dfa tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:00.952274 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cb1d077-cff4-4fba-a41d-1db7a78b9dfa tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:00.952755 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cb1d077-cff4-4fba-a41d-1db7a78b9dfa tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:00.953248 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cb1d077-cff4-4fba-a41d-1db7a78b9dfa tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:01.018728 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3cb1d077-cff4-4fba-a41d-1db7a78b9dfa tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:01.036891 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3cb1d077-cff4-4fba-a41d-1db7a78b9dfa tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 200 len: 1223 microversion: 2.1 time: 0.097383 Sep 17 21:22:01.037794 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 612/1255] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:00 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:22:02.061717 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73bf79f9-74ac-4a38-ac5a-20359cbdcb05 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:02.062926 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-73bf79f9-74ac-4a38-ac5a-20359cbdcb05 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0d5a0302-77e9-48cb-b21d-a3fd09378dab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:02.069349 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73bf79f9-74ac-4a38-ac5a-20359cbdcb05 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:02.069833 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73bf79f9-74ac-4a38-ac5a-20359cbdcb05 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:02.070275 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73bf79f9-74ac-4a38-ac5a-20359cbdcb05 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:02.070973 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73bf79f9-74ac-4a38-ac5a-20359cbdcb05 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:02.071431 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73bf79f9-74ac-4a38-ac5a-20359cbdcb05 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:02.071860 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73bf79f9-74ac-4a38-ac5a-20359cbdcb05 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:02.086087 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-73bf79f9-74ac-4a38-ac5a-20359cbdcb05 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] HTTP exception thrown: Instance 0d5a0302-77e9-48cb-b21d-a3fd09378dab could not be found. Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73bf79f9-74ac-4a38-ac5a-20359cbdcb05 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Request method failure captured: Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab HTTP/1.1 Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjhZ8Rpzpj5dpT6ab3M0cBQplyxStv5x4tEFLGvufqNEAS9XbA_csnSy33ax09N3LS-9-2rafCtGHxu78lyYEmOx5fAqlmtTlDj6a8-gbbTm1CYw1mwyATDl8YLTePpAA_6rO-c51WUJy8VjJEM5HkRHSlWnmLftRSte-bJjb-3xp1E Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: f58304cb0e1a42ce9bbc5ea8a3e58899 Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:22:02.087693 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:22:02.089520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:22:02.089520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:22:02.089520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: f58304cb0e1a42ce9bbc5ea8a3e58899 Sep 17 21:22:02.089520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:22:02.089520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-1802986980-project Sep 17 21:22:02.089520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:22:02.089520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:22:02.089520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 91f2a01f833d4751a6f81d6a8f11b8ed Sep 17 21:22:02.089520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-1802986980-project Sep 17 21:22:02.089520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:22:02.089520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 0d5a0302-77e9-48cb-b21d-a3fd09378dab could not be found. Sep 17 21:22:02.089520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '0d5a0302-77e9-48cb-b21d-a3fd09378dab'} Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5a0302-77e9-48cb-b21d-a3fd09378dab could not be found. Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:22:02.090707 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5a0302-77e9-48cb-b21d-a3fd09378dab could not be found. Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5a0302-77e9-48cb-b21d-a3fd09378dab could not be found. Sep 17 21:22:02.092576 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:02.094655 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73bf79f9-74ac-4a38-ac5a-20359cbdcb05 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Returning 404 to user: Instance 0d5a0302-77e9-48cb-b21d-a3fd09378dab could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:22:02.094655 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-73bf79f9-74ac-4a38-ac5a-20359cbdcb05 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab" status: 404 len: 111 microversion: 2.1 time: 0.032381 Sep 17 21:22:02.094655 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 644/1256] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:02 2022] GET /compute/v2.1/servers/0d5a0302-77e9-48cb-b21d-a3fd09378dab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:22:05.178856 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aedf5a2b-992a-45cb-b0eb-50911ede85f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:05.179371 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aedf5a2b-992a-45cb-b0eb-50911ede85f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:05.181891 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b7a6848c-2c4e-4418-abf0-6f22af1fb4b3 req-981c1904-2778-4727-960b-ad8ab2e96bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba21559-e201-4ff9-9540-a3b4ff5669f9", "tag": "84d22448-fb27-4048-ad72-a4d673960323"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:05.186126 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aedf5a2b-992a-45cb-b0eb-50911ede85f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:05.186605 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aedf5a2b-992a-45cb-b0eb-50911ede85f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:05.187033 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aedf5a2b-992a-45cb-b0eb-50911ede85f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:05.187713 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aedf5a2b-992a-45cb-b0eb-50911ede85f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:05.188346 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aedf5a2b-992a-45cb-b0eb-50911ede85f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:05.189354 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aedf5a2b-992a-45cb-b0eb-50911ede85f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:05.194069 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b7a6848c-2c4e-4418-abf0-6f22af1fb4b3 req-981c1904-2778-4727-960b-ad8ab2e96bd2 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:05.194746 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b7a6848c-2c4e-4418-abf0-6f22af1fb4b3 req-981c1904-2778-4727-960b-ad8ab2e96bd2 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:05.195256 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b7a6848c-2c4e-4418-abf0-6f22af1fb4b3 req-981c1904-2778-4727-960b-ad8ab2e96bd2 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:05.206793 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b7a6848c-2c4e-4418-abf0-6f22af1fb4b3 req-981c1904-2778-4727-960b-ad8ab2e96bd2 service nova] Creating event network-changed:84d22448-fb27-4048-ad72-a4d673960323 for instance bba21559-e201-4ff9-9540-a3b4ff5669f9 on hv-cinder-82651 Sep 17 21:22:05.211935 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b7a6848c-2c4e-4418-abf0-6f22af1fb4b3 req-981c1904-2778-4727-960b-ad8ab2e96bd2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034044 Sep 17 21:22:05.212622 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 645/1257] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:22:05.218664 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aedf5a2b-992a-45cb-b0eb-50911ede85f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:22:05.314152 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aedf5a2b-992a-45cb-b0eb-50911ede85f4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 204 len: 0 microversion: 2.1 time: 0.138379 Sep 17 21:22:05.318032 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 613/1258] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:22:05 2022] DELETE /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:22:05.323638 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-54d69d25-4870-49e4-9ad7-827f23ed6252 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:05.324387 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-54d69d25-4870-49e4-9ad7-827f23ed6252 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:05.332271 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54d69d25-4870-49e4-9ad7-827f23ed6252 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:05.332776 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54d69d25-4870-49e4-9ad7-827f23ed6252 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:05.333210 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54d69d25-4870-49e4-9ad7-827f23ed6252 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:05.333910 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54d69d25-4870-49e4-9ad7-827f23ed6252 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:05.334359 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54d69d25-4870-49e4-9ad7-827f23ed6252 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:05.334778 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54d69d25-4870-49e4-9ad7-827f23ed6252 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:05.480128 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.policy [None req-54d69d25-4870-49e4-9ad7-827f23ed6252 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:05.488270 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-54d69d25-4870-49e4-9ad7-827f23ed6252 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1575 microversion: 2.1 time: 0.168760 Sep 17 21:22:05.488859 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 646/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:05 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:06.512942 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b0ca5c9-0cf5-49f9-980c-4bdcec34edea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:06.513648 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b0ca5c9-0cf5-49f9-980c-4bdcec34edea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:06.520562 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b0ca5c9-0cf5-49f9-980c-4bdcec34edea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:06.521081 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b0ca5c9-0cf5-49f9-980c-4bdcec34edea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:06.521521 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b0ca5c9-0cf5-49f9-980c-4bdcec34edea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:06.522223 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b0ca5c9-0cf5-49f9-980c-4bdcec34edea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:06.522680 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b0ca5c9-0cf5-49f9-980c-4bdcec34edea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:06.523107 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b0ca5c9-0cf5-49f9-980c-4bdcec34edea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:06.656616 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b0ca5c9-0cf5-49f9-980c-4bdcec34edea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:06.665021 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b0ca5c9-0cf5-49f9-980c-4bdcec34edea tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1575 microversion: 2.1 time: 0.156662 Sep 17 21:22:06.665584 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 614/1260] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:06 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:07.497628 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-fec7a88c-b424-4466-9b1d-35ef4a9c931f req-469030f5-cdca-42f5-a012-3d1bbbe5a1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba21559-e201-4ff9-9540-a3b4ff5669f9", "name": "network-vif-deleted", "tag": "84d22448-fb27-4048-ad72-a4d673960323"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:07.508619 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fec7a88c-b424-4466-9b1d-35ef4a9c931f req-469030f5-cdca-42f5-a012-3d1bbbe5a1f2 service nova] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:07.509143 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fec7a88c-b424-4466-9b1d-35ef4a9c931f req-469030f5-cdca-42f5-a012-3d1bbbe5a1f2 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:07.509582 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fec7a88c-b424-4466-9b1d-35ef4a9c931f req-469030f5-cdca-42f5-a012-3d1bbbe5a1f2 service nova] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:07.521268 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fec7a88c-b424-4466-9b1d-35ef4a9c931f req-469030f5-cdca-42f5-a012-3d1bbbe5a1f2 service nova] Creating event network-vif-deleted:84d22448-fb27-4048-ad72-a4d673960323 for instance bba21559-e201-4ff9-9540-a3b4ff5669f9 on hv-cinder-82651 Sep 17 21:22:07.525938 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-fec7a88c-b424-4466-9b1d-35ef4a9c931f req-469030f5-cdca-42f5-a012-3d1bbbe5a1f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032389 Sep 17 21:22:07.526520 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 647/1261] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 17 21:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:22:07.689005 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-93d0df9f-995b-4218-a5f1-f62f32aa1955 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:07.689661 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-93d0df9f-995b-4218-a5f1-f62f32aa1955 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:07.697008 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93d0df9f-995b-4218-a5f1-f62f32aa1955 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:07.697591 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93d0df9f-995b-4218-a5f1-f62f32aa1955 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:07.698087 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93d0df9f-995b-4218-a5f1-f62f32aa1955 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:07.698842 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93d0df9f-995b-4218-a5f1-f62f32aa1955 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:07.699362 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93d0df9f-995b-4218-a5f1-f62f32aa1955 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:07.699942 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93d0df9f-995b-4218-a5f1-f62f32aa1955 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:07.763438 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-93d0df9f-995b-4218-a5f1-f62f32aa1955 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f2a01f833d4751a6f81d6a8f11b8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58304cb0e1a42ce9bbc5ea8a3e58899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:07.775672 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-93d0df9f-995b-4218-a5f1-f62f32aa1955 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 200 len: 1224 microversion: 2.1 time: 0.090370 Sep 17 21:22:07.776350 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 615/1262] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:07 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:22:08.801221 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99a3d0a7-b488-4348-a1ea-4b1b3c693dd2 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:08.801920 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-99a3d0a7-b488-4348-a1ea-4b1b3c693dd2 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: bba21559-e201-4ff9-9540-a3b4ff5669f9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:08.809353 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99a3d0a7-b488-4348-a1ea-4b1b3c693dd2 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:08.809855 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99a3d0a7-b488-4348-a1ea-4b1b3c693dd2 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:08.810292 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99a3d0a7-b488-4348-a1ea-4b1b3c693dd2 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:08.810987 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99a3d0a7-b488-4348-a1ea-4b1b3c693dd2 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:08.811443 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99a3d0a7-b488-4348-a1ea-4b1b3c693dd2 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:08.811867 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99a3d0a7-b488-4348-a1ea-4b1b3c693dd2 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:08.825607 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-99a3d0a7-b488-4348-a1ea-4b1b3c693dd2 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] HTTP exception thrown: Instance bba21559-e201-4ff9-9540-a3b4ff5669f9 could not be found. Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99a3d0a7-b488-4348-a1ea-4b1b3c693dd2 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Request method failure captured: Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 HTTP/1.1 Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjhZ8Rpzpj5dpT6ab3M0cBQplyxStv5x4tEFLGvufqNEAS9XbA_csnSy33ax09N3LS-9-2rafCtGHxu78lyYEmOx5fAqlmtTlDj6a8-gbbTm1CYw1mwyATDl8YLTePpAA_6rO-c51WUJy8VjJEM5HkRHSlWnmLftRSte-bJjb-3xp1E Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: f58304cb0e1a42ce9bbc5ea8a3e58899 Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:22:08.827197 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:22:08.829476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:22:08.829476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:22:08.829476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: f58304cb0e1a42ce9bbc5ea8a3e58899 Sep 17 21:22:08.829476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:22:08.829476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-1802986980-project Sep 17 21:22:08.829476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:22:08.829476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:22:08.829476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 91f2a01f833d4751a6f81d6a8f11b8ed Sep 17 21:22:08.829476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-1802986980-project Sep 17 21:22:08.829476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:22:08.829476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance bba21559-e201-4ff9-9540-a3b4ff5669f9 could not be found. Sep 17 21:22:08.829476 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': 'bba21559-e201-4ff9-9540-a3b4ff5669f9'} Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba21559-e201-4ff9-9540-a3b4ff5669f9 could not be found. Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:22:08.830478 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba21559-e201-4ff9-9540-a3b4ff5669f9 could not be found. Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba21559-e201-4ff9-9540-a3b4ff5669f9 could not be found. Sep 17 21:22:08.832118 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:08.833712 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99a3d0a7-b488-4348-a1ea-4b1b3c693dd2 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Returning 404 to user: Instance bba21559-e201-4ff9-9540-a3b4ff5669f9 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:22:08.833712 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-99a3d0a7-b488-4348-a1ea-4b1b3c693dd2 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9" status: 404 len: 111 microversion: 2.1 time: 0.032948 Sep 17 21:22:08.833712 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 648/1263] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:08 2022] GET /compute/v2.1/servers/bba21559-e201-4ff9-9540-a3b4ff5669f9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:22:09.263085 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b75849af-2233-4e7e-9d90-723352431644 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:09.263581 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b75849af-2233-4e7e-9d90-723352431644 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:09.270476 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b75849af-2233-4e7e-9d90-723352431644 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:09.270966 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b75849af-2233-4e7e-9d90-723352431644 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:09.271404 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b75849af-2233-4e7e-9d90-723352431644 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:09.272101 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b75849af-2233-4e7e-9d90-723352431644 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:09.272561 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b75849af-2233-4e7e-9d90-723352431644 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:09.273015 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b75849af-2233-4e7e-9d90-723352431644 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:09.286816 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b75849af-2233-4e7e-9d90-723352431644 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] HTTP exception thrown: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b75849af-2233-4e7e-9d90-723352431644 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Request method failure captured: Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad HTTP/1.1 Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept: application/json Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Connection: close Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Length: 0 Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Content-Type: application/json Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Host: 10.222.0.16 Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjJjhZ8Rpzpj5dpT6ab3M0cBQplyxStv5x4tEFLGvufqNEAS9XbA_csnSy33ax09N3LS-9-2rafCtGHxu78lyYEmOx5fAqlmtTlDj6a8-gbbTm1CYw1mwyATDl8YLTePpAA_6rO-c51WUJy8VjJEM5HkRHSlWnmLftRSte-bJjb-3xp1E Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Id: f58304cb0e1a42ce9bbc5ea8a3e58899 Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Role: member,reader Sep 17 21:22:09.288459 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Sep 17 21:22:09.290207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:22:09.290207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:22:09.290207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Id: f58304cb0e1a42ce9bbc5ea8a3e58899 Sep 17 21:22:09.290207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:22:09.290207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-1802986980-project Sep 17 21:22:09.290207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Sep 17 21:22:09.290207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Sep 17 21:22:09.290207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Id: 91f2a01f833d4751a6f81d6a8f11b8ed Sep 17 21:22:09.290207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-1802986980-project Sep 17 21:22:09.290207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: method: > Sep 17 21:22:09.290207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: exception: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:22:09.290207 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: action_args: {'id': '0c20c116-f378-4a7e-812b-45a6824e98ad'} Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:22:09.292003 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:22:09.293681 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Sep 17 21:22:09.295329 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b75849af-2233-4e7e-9d90-723352431644 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Returning 404 to user: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:22:09.295329 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b75849af-2233-4e7e-9d90-723352431644 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 404 len: 111 microversion: 2.1 time: 0.030611 Sep 17 21:22:09.295329 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 616/1264] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 17 21:22:09 2022] DELETE /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:22:09.299287 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-36a9f182-a242-47a7-b9bf-5a5418d368fc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:09.299894 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-36a9f182-a242-47a7-b9bf-5a5418d368fc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] [instance: 0c20c116-f378-4a7e-812b-45a6824e98ad] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:09.305840 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36a9f182-a242-47a7-b9bf-5a5418d368fc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:09.306323 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36a9f182-a242-47a7-b9bf-5a5418d368fc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:09.306770 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36a9f182-a242-47a7-b9bf-5a5418d368fc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:09.307454 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36a9f182-a242-47a7-b9bf-5a5418d368fc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Acquiring lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:09.307908 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36a9f182-a242-47a7-b9bf-5a5418d368fc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:09.308333 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36a9f182-a242-47a7-b9bf-5a5418d368fc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Lock "e02f9b70-dae4-46dc-9136-6abdbb093c64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:09.321803 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-36a9f182-a242-47a7-b9bf-5a5418d368fc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] HTTP exception thrown: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-36a9f182-a242-47a7-b9bf-5a5418d368fc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Request method failure captured: Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad HTTP/1.1 Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept: application/json Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Accept-Encoding: identity Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Connection: close Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Length: 0 Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Content-Type: application/json Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Host: 10.222.0.16 Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: Openstack-System-Scope: None Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjJjhZ8Rpzpj5dpT6ab3M0cBQplyxStv5x4tEFLGvufqNEAS9XbA_csnSy33ax09N3LS-9-2rafCtGHxu78lyYEmOx5fAqlmtTlDj6a8-gbbTm1CYw1mwyATDl8YLTePpAA_6rO-c51WUJy8VjJEM5HkRHSlWnmLftRSte-bJjb-3xp1E Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Id: None Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Domain-Name: None Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Identity-Status: Confirmed Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Is-Admin-Project: True Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Id: default Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Domain-Name: Default Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Id: f58304cb0e1a42ce9bbc5ea8a3e58899 Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Role: member,reader Sep 17 21:22:09.323312 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Roles: member,reader Sep 17 21:22:09.325055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f58304cb0e1a42ce9bbc5ea8a3e58899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Sep 17 21:22:09.325055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:22:09.325055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Id: f58304cb0e1a42ce9bbc5ea8a3e58899 Sep 17 21:22:09.325055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802986980 Sep 17 21:22:09.325055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-1802986980-project Sep 17 21:22:09.325055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Id: default Sep 17 21:22:09.325055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Domain-Name: Default Sep 17 21:22:09.325055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Id: 91f2a01f833d4751a6f81d6a8f11b8ed Sep 17 21:22:09.325055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-1802986980-project Sep 17 21:22:09.325055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: method: > Sep 17 21:22:09.325055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: exception: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:22:09.325055 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: action_args: {'id': '0c20c116-f378-4a7e-812b-45a6824e98ad'} Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:22:09.326164 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. Sep 17 21:22:09.327805 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Sep 17 21:22:09.329493 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-36a9f182-a242-47a7-b9bf-5a5418d368fc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Returning 404 to user: Instance 0c20c116-f378-4a7e-812b-45a6824e98ad could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:22:09.329493 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-36a9f182-a242-47a7-b9bf-5a5418d368fc tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad" status: 404 len: 111 microversion: 2.1 time: 0.029998 Sep 17 21:22:09.329493 dv-cinder-826510-9-iscsi devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 649/1265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:09 2022] GET /compute/v2.1/servers/0c20c116-f378-4a7e-812b-45a6824e98ad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:22:10.613586 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75ebfd7c-b81b-4b25-a55a-3876f5fc67b4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] Calling method '.version_select at 0x7f9ba7619430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:10.639000 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75ebfd7c-b81b-4b25-a55a-3876f5fc67b4 tempest-TestVolumeBootPattern-1802986980 tempest-TestVolumeBootPattern-1802986980-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-70796160" status: 202 len: 0 microversion: 2.1 time: 0.029296 Sep 17 21:22:10.639599 dv-cinder-826510-9-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 617/1266] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Sep 17 21:22:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-70796160 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)